-- Logs begin at Tue 2022-07-26 13:52:05 UTC, end at Tue 2022-07-26 15:19:16 UTC. -- Jul 26 14:42:26.095439 dv-cinder-851030-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 14:42:26.105272 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:42:26 2022] *** Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: nodename: dv-cinder-851030-1-iscsi Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: machine: x86_64 Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: clock source: unix Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: pcre jit disabled Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: detected number of CPU cores: 4 Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: current working directory: / Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: your processes number limit is 47680 Jul 26 14:42:26.106313 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: your memory page size is 4096 bytes Jul 26 14:42:26.107268 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: detected max file descriptor number: 2048 Jul 26 14:42:26.107268 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: lock engine: pthread robust mutexes Jul 26 14:42:26.107268 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: thunder lock: enabled Jul 26 14:42:26.107268 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 14:42:26.107268 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:42:26.146819 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: Python main interpreter initialized at 0x56358bde79c0 Jul 26 14:42:26.146819 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: python threads support enabled Jul 26 14:42:26.146819 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: your server socket listen backlog is limited to 100 connections Jul 26 14:42:26.146819 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:42:26.147200 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:42:26.147279 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: *** Operational MODE: preforking *** Jul 26 14:42:26.147523 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:42:26.147523 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: spawned uWSGI master process (pid: 110316) Jul 26 14:42:26.147729 dv-cinder-851030-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 14:42:26.151912 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: spawned uWSGI worker 1 (pid: 110317, cores: 1) Jul 26 14:42:26.151912 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: spawned uWSGI worker 2 (pid: 110318, cores: 1) Jul 26 14:42:26.151912 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:42:26.817791 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:42:26.827167 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:42:27.923018 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:42:27.923018 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: from cryptography.utils import int_from_bytes Jul 26 14:42:27.923689 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:42:27.923689 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: from cryptography.utils import int_from_bytes Jul 26 14:42:27.924997 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:42:27.924997 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: from cryptography.utils import int_from_bytes Jul 26 14:42:27.925418 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:42:27.925418 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: from cryptography.utils import int_from_bytes Jul 26 14:42:30.420455 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:42:30.420976 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:42:30.421139 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:42:30.421494 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:42:30.421746 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:42:30.421857 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:42:30.422216 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:42:30.422300 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.422425 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.422566 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:42:30.422744 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.422930 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:42:30.423079 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.423168 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:42:30.423422 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.423580 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.423733 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.423905 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424048 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424226 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424361 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424542 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424685 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424870 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.424975 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425209 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425341 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425528 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425675 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851030-1-iscsi {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425843 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.425982 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426161 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426289 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426474 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426603 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426826 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.426962 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427144 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427279 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851030-1-iscsi {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427522 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427654 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427828 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.427958 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.428222 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.428431 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.429178 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.429301 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.429494 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.429610 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.429894 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430042 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430223 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430345 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430533 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430786 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.430928 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431152 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431285 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431481 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431615 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431828 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.431979 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432128 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432258 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432522 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432660 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851030-1-iscsi {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432834 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.432964 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433142 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433283 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433430 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433568 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433757 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.433899 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434065 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434241 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434436 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434559 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851030-1-iscsi {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434765 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.434936 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.435119 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.435249 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.435484 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.435620 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.435770 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436029 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436174 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436339 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436470 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436688 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436830 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.436986 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437121 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437290 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437429 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437594 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437811 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.437948 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.438344 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.438528 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.438681 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.438808 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.438946 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.439217 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.439347 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.439568 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.439701 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.439942 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440082 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440395 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440534 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440694 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.440910 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441046 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441173 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441304 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441498 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441676 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.441893 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442042 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442191 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442332 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442617 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442862 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.442955 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.443194 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.443388 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.443563 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.443810 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.443969 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.444172 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.444379 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.444504 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.444733 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.444953 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.445091 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.445371 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.445503 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.445733 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.445880 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446048 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446180 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446410 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446535 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446744 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.446900 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447110 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447233 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447464 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447621 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447830 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.447921 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448160 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448273 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448456 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448603 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448736 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.448851 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.449036 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.449267 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.449445 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.449684 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.449814 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450012 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450119 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450293 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450513 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450664 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450829 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.450967 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451104 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451247 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451444 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451605 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451736 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.451872 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452019 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452247 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452381 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452592 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452742 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.452918 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453060 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453241 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453426 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453578 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453798 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.453929 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454200 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454327 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454502 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454642 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454809 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.454961 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.455157 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.455356 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.455514 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.455652 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.455779 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456009 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456139 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456317 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456617 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456775 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.456915 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457156 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457285 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457514 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457653 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457833 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.457960 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458152 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458281 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458481 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458699 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458837 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.458998 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.459137 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.459355 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.459532 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.459748 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.459877 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460049 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460186 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460396 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460536 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460663 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.460877 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461009 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461276 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461416 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461630 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461760 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.461986 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.462177 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.462392 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.462698 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.462826 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463002 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463196 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463340 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463525 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463675 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463842 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.463982 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464207 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464517 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464662 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464836 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.464973 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.465150 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.465286 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.465445 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.465617 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.465748 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.466003 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.466134 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.466331 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.466461 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.466698 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.466833 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.467060 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.467191 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.467432 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.467565 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.467780 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.467923 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.468128 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.468264 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.468465 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.468638 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.468792 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.469050 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.469191 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.469448 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.469586 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.469816 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.469943 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.470153 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.470434 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.470555 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.470722 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.470997 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.471107 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.471195 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.471375 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.471563 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.471736 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.471860 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.472047 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.472192 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.472376 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.472480 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.472678 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.472818 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.472978 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.473191 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.473305 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.473517 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.473695 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.473917 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.474075 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.474251 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.474342 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.474590 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.474754 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:42:30.474895 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.475017 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.475803 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.475982 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.476130 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.476354 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.476494 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.476701 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.476833 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477039 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477172 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477376 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477577 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477773 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.477942 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478103 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478355 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478502 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478696 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478847 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.478996 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.479135 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.479295 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.479527 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.479678 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.479866 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480032 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480179 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480328 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480553 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480703 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480845 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.480984 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.481123 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.481272 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.481421 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.481645 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.481793 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482018 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482165 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482427 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482581 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482752 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.482900 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.483079 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.483372 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.483567 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.483731 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.483877 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484024 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484164 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484326 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484489 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484646 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.484857 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485005 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485272 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485429 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485610 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485755 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.485923 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486071 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486253 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486464 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486835 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.486981 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487161 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487315 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487518 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487667 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487807 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.487955 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.488129 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.488290 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.488430 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.488576 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.488725 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489085 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489233 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489397 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489536 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489674 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489813 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.489975 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.490121 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.490272 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.490483 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.490646 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.491485 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.491653 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.491806 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.491947 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492093 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492234 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492398 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492603 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492755 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.492896 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493035 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493262 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493418 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493599 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493755 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.493944 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494104 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494285 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494432 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494601 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494757 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.494897 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495037 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495344 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495529 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495707 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.495854 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496019 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496165 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496373 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496605 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496754 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.496961 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497108 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497292 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497436 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497614 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497761 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.497920 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498061 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498199 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498372 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498532 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498711 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.498872 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499083 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499227 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499389 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499571 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499738 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.499897 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500046 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500219 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500376 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500546 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500706 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.500872 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501086 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501231 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501384 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501581 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501739 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.501887 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502036 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502206 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502363 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502515 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502663 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502838 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.502984 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.503178 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.503424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.503576 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.503741 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.503890 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504059 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504241 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504381 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504520 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504688 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.504834 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505007 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505168 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505315 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505453 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505591 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505729 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.505904 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506065 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506221 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506361 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506588 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506733 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.506916 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507072 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507213 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507350 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507561 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507701 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507855 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.507996 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508157 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508297 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508443 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508582 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508728 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.508868 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.509013 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.509412 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.509603 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.509747 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.509895 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510048 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510192 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510345 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510483 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510628 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510777 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.510915 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511070 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511291 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511461 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511620 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511761 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.511900 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512038 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512333 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512481 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512631 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512771 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.512910 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513047 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513185 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513333 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513473 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513621 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513761 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.513899 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514071 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514237 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514379 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514517 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514704 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.514859 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515008 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515157 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515296 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515479 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515637 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515778 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.515925 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516066 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516215 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516362 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516502 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516640 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516787 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.516927 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517096 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517242 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517416 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517570 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517722 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.517862 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518010 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518147 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518318 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518471 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518612 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518756 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.518925 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519071 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519242 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519427 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519577 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519717 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.519855 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520004 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520151 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520305 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520445 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520583 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520722 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.520860 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521005 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521157 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521328 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521538 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521685 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521832 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.521982 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.522668 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.522811 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.522950 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523242 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523390 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523571 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523711 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.523851 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524000 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524141 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524293 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524512 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524660 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.524857 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525004 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525168 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525324 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525465 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525604 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525764 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.525911 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526051 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526267 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526416 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526567 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526706 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526845 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.526994 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.527188 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.527333 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.527579 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.527726 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.527894 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528054 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528201 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528339 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528494 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528633 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528800 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.528955 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.529265 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.529417 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.529579 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.529724 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.529891 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530047 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530195 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530333 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530495 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530651 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530800 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.530939 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531089 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531228 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531365 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531577 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531802 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.531956 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532111 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532260 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532401 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532538 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532696 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532844 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.532990 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533130 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533269 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533407 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533560 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533707 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533847 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.533985 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534123 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534302 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534456 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534620 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534760 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.534898 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535036 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535174 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535321 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535498 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535643 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535782 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.535921 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536067 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536216 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536382 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536529 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536669 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536807 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.536944 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.537119 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.537266 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.537429 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.537584 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.538287 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.538443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.538596 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.538736 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.538894 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539040 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539212 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539359 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539547 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539690 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.539865 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540012 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540186 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540342 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540523 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540670 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540809 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.540967 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.541113 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.541274 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.541414 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.541553 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.541692 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.542505 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.542657 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.542807 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.542947 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543094 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543233 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543378 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543603 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543603 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.543872 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544011 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544150 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544288 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544436 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544584 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544730 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.544870 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545008 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545148 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545307 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545460 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545600 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545746 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.545895 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546041 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546194 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546343 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546492 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546639 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546792 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.546939 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547084 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547248 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547427 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547582 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547729 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.547876 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548032 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548192 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548339 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548484 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548630 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.548930 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549077 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549233 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549378 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549523 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549668 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549822 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.549970 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550115 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550261 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550406 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550558 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550784 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.550940 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551093 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551255 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551418 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551581 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551738 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.551884 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552063 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552225 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552398 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552629 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552781 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.552928 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.553081 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.553246 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.553534 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.553707 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.553856 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554009 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554156 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554308 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554308 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554601 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554748 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.554892 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555036 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555181 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555338 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555542 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555839 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.555994 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556141 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556287 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556441 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556588 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556741 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.556887 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557047 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557200 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557356 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557513 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557658 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557803 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.557955 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558100 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558258 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558406 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558551 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558696 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558849 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.558994 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559148 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559294 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559476 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559639 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559786 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.559939 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560093 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560246 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560399 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560545 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560690 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560843 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.560989 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561140 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561302 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561592 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561746 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.561892 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562037 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562190 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562335 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562480 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562652 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562841 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.562991 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.563150 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.563316 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.563565 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.563719 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.563865 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564010 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564246 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564408 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564564 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564712 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.564858 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565010 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565165 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565617 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.565771 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566003 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566165 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566320 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566477 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566625 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566780 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.566926 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567071 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567230 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567384 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567572 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567719 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567866 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.567866 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568155 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568155 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568431 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568577 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568729 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.568901 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569071 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569219 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569364 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569520 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569664 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569810 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.569968 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570115 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570260 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570404 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570549 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570704 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.570851 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.571072 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.571314 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.571550 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.571709 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.571907 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572063 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572210 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572355 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572500 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572646 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572800 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.572947 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573093 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573238 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573383 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573547 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573703 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.573849 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574002 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574149 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574294 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574452 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574599 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574743 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.574888 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575032 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575178 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575333 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575514 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575661 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.575963 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576213 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576375 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576523 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576669 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576815 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.576960 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577106 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577265 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577413 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577569 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577715 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.577861 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578006 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578161 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578308 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578460 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578607 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578752 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.578907 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579055 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579208 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579394 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579586 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579733 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579965 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.579965 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.580245 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.580401 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.580547 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.580699 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.580858 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581004 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581160 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581307 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581464 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581636 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581809 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.581957 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582102 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582247 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582400 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582558 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582711 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.582858 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583003 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583148 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583293 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583495 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583651 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583797 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.583941 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.584085 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.584230 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.584384 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585056 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585211 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585357 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585510 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585664 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585823 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.585980 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586127 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586358 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586511 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586668 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586814 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.586959 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587117 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587264 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587456 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587456 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587456 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.587906 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588058 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588204 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588348 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588506 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588653 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588799 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.588942 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589087 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589231 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589384 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589384 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589660 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589817 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.589961 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.590118 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.590285 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.590440 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.590699 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.590858 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591011 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591168 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591340 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591533 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591706 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.591857 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592015 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592161 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592313 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592468 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592614 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592789 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.592943 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593089 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593234 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593390 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593544 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593689 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593845 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.593997 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594143 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594302 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594448 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594601 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594746 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594897 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.594897 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.595184 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.595330 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.595551 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.595708 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.595865 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596020 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596168 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596339 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596561 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596713 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.596859 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597018 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597166 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597311 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597456 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597600 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597746 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.597915 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598062 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598216 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598363 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598516 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598670 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598816 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.598960 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599113 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599260 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599449 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599573 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599664 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599747 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599827 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599907 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.599994 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.600085 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.600166 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.600271 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.600905 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.600999 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601091 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601172 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601247 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601328 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601406 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601493 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601582 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601663 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601741 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601820 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601898 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.601977 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602065 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602145 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602225 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602303 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602382 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602460 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602547 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602629 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602714 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602794 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602879 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.602959 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603046 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603162 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603265 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603485 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603578 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603791 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.603884 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604111 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604202 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604415 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604506 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604736 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.604833 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605049 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605137 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605361 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605448 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605669 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605759 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.605969 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606056 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606287 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606382 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606595 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606691 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606896 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.606991 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607199 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607310 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607520 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607626 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607843 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.607930 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608151 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608252 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608462 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608550 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608791 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.608982 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609116 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609307 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609426 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609616 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609758 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.609924 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610085 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610231 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610402 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610542 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610721 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.610851 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611042 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611158 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611345 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611495 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611670 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611821 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.611978 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612130 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612281 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612453 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612585 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612791 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.612890 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613115 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613204 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613444 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613533 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613755 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.613851 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614056 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614145 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614364 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614451 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614663 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614751 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.614982 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.615070 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.615287 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.615384 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.615611 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.615700 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.616453 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.616566 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.616756 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.616854 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617094 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617187 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617396 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617491 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617700 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.617865 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618010 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618109 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618318 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618414 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618623 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618721 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.618927 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619060 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619236 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619325 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619572 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619668 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619882 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.619969 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620196 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620286 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620509 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620606 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620816 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.620903 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.621671 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.621775 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.621775 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.621944 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.621944 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622086 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622173 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622253 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622340 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622560 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622662 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.622882 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623133 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623236 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623482 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623576 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623798 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.623886 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624111 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624211 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624423 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624520 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624728 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.624823 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625035 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625132 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625341 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625430 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625639 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625734 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.625945 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626032 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626247 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626340 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626547 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626642 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626860 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.626948 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.627163 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.627250 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.627561 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.627760 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.627887 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628126 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628216 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628439 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628527 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628778 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.628874 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629102 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629191 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629416 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629512 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629779 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.629888 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.630055 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.630154 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.630416 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.630526 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.630879 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631105 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631194 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631274 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631353 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631595 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631690 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.631896 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.632643 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.632742 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.632995 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.633480 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.633595 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.633595 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.633744 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.634466 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.634466 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.634982 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635081 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635163 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635242 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635322 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635442 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635655 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635745 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.635964 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636053 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636266 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636372 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636565 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636660 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.636863 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.637040 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.637225 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.637371 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.637851 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.637963 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.638233 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.638430 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.638567 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.638948 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.639050 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.639529 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.639634 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.639757 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.639860 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640054 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640192 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640386 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640516 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640724 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.640854 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641027 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641116 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641329 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641458 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641674 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.641850 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642018 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642253 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642339 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642564 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642713 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642858 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.642980 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.643256 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.643366 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.643651 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.643857 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.644027 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.644601 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.644822 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.645009 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.645335 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.645440 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.645669 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.645974 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646107 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646308 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646432 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646614 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646745 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.646941 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647206 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647336 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647517 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647692 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647786 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.647912 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648060 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648226 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648365 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648530 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648620 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648838 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.648926 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649333 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649468 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649562 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649645 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649755 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.649846 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650062 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650230 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650369 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650466 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650677 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650765 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.650982 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651080 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651290 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651382 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651620 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651711 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.651968 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652069 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652282 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652382 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652618 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652707 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.652922 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653011 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653227 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653322 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653537 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653676 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653864 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.653955 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654175 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654272 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654487 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654577 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654796 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.654934 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655104 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655231 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655452 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655600 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655764 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.655894 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656077 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656202 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656387 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656542 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656808 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.656941 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657115 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657296 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657419 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657569 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657741 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.657876 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658081 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658211 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658390 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658581 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658705 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.658834 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659005 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659144 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659322 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659644 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659774 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.659972 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660098 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660291 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660435 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660623 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660748 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.660946 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661072 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661248 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661376 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661552 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661681 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.661854 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662015 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662157 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662353 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662492 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662692 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.662845 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663000 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663149 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663311 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663506 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663654 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663789 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.663990 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664129 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664309 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664466 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664597 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664736 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.664878 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665029 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665152 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665279 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665450 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665589 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665750 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.665887 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666051 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666178 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666349 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666475 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666648 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666777 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.666968 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667095 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667277 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667482 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667609 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667740 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.667886 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668013 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668159 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668301 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668459 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668587 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668757 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.668886 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669103 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669245 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669435 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669563 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669746 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.669874 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670065 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670205 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670374 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670552 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670687 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670813 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.670981 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671139 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671299 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671469 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671645 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671733 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.671959 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672049 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672264 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672365 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672592 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672685 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672899 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.672992 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673225 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673537 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673639 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673845 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.673945 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674150 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674304 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674605 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674785 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674876 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.674957 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.675119 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.675271 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.675552 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.675763 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.675857 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676143 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676292 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676476 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676586 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676835 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.676942 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677116 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677199 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677479 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677608 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677783 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.677866 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.678132 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.678246 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.678931 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.679265 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.679559 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.679726 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.679812 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.679907 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680161 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680434 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680529 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680716 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.680920 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681194 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681461 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681571 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681759 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681846 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.681947 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682039 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682136 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682232 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682324 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682428 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682428 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682624 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682738 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682822 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.682923 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683035 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683122 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683229 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683452 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683562 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683651 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683779 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.683887 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684061 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684160 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684377 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684475 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684669 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:42:30.684816 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.684998 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.685319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.685627 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.685948 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.686272 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.686584 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.686893 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.687227 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.687570 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.687886 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.688199 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.688511 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.688816 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.689128 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.689455 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.689777 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.690079 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.690405 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.690722 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.691042 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.691356 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.691690 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.692017 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.692329 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.692639 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.692947 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.693256 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.693567 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.693894 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.694774 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.695088 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.695428 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.695740 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.696069 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.696399 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.696704 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.697029 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.697356 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.697709 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.698021 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.698367 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.698693 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.699010 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.699319 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.699647 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:42:30.699894 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:42:30.839716 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Registered counter for database nova_api Jul 26 14:42:30.854358 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Registered counter for database nova_api Jul 26 14:42:30.861395 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.868509 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:30.875557 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.882736 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:30.924897 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.context [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b94e0a29-23eb-489d-a693-b18b7475483a(cell1) {{(pid=110317) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:42:30.929400 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.931110 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:30.931932 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.934107 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:30.936346 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Registered counter for database nova_cell0 Jul 26 14:42:30.941832 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.context [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b94e0a29-23eb-489d-a693-b18b7475483a(cell1) {{(pid=110318) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:42:30.942077 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Registered counter for database nova_cell1 Jul 26 14:42:30.947501 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.949149 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:30.949972 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:42:30.952681 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.952816 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_concurrency.lockutils [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:42:30.953109 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.954092 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Registered counter for database nova_cell0 Jul 26 14:42:30.959872 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Registered counter for database nova_cell1 Jul 26 14:42:30.960391 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:30.968477 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.969311 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:30.976473 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:30.978229 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:31.103194 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:31.113240 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO dbcounter [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Registered counter for database nova_cell0 Jul 26 14:42:31.121801 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO dbcounter [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Registered counter for database nova_cell0 Jul 26 14:42:31.122334 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_db.sqlalchemy.engines [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:31.127564 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writer thread running {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:31.128821 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG oslo_db.sqlalchemy.engines [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:42:31.134839 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writer thread running {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:42:31.580924 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:42:31.589045 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:42:31.599904 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:42:31.607714 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:42:31.937894 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:42:31.944563 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: WARNING keystonemiddleware.auth_token [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:42:31.949870 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56358bde79c0 pid: 110317 (default app) Jul 26 14:42:31.952063 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:42:31.953276 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] 10.222.0.97 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001820 Jul 26 14:42:31.953700 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 1/1] 10.222.0.97 () {50 vars in 788 bytes} [Tue Jul 26 14:42:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:42:31.963833 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:42:31.969834 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: WARNING keystonemiddleware.auth_token [None req-6aa6906a-187b-4072-abf5-c0ecbd962dd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:42:31.975841 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56358bde79c0 pid: 110318 (default app) Jul 26 14:43:53.666496 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:53.667575 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 26 14:43:53.668224 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 2/2] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:53.683838 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.684952 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell0:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.686025 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell1:SELECT=3 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:53.686851 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:54.620345 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-1e1dd3b5-6402-4b91-b2f4-3a95fa96d05b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:54.655515 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-1e1dd3b5-6402-4b91-b2f4-3a95fa96d05b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.980678 Jul 26 14:43:54.660842 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 1/3] 10.222.0.97 () {60 vars in 1291 bytes} [Tue Jul 26 14:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:43:56.886721 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:43:56.886721 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-efd2a346-b114-4935-9d93-13e0fb619e8e None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002155 Jul 26 14:43:56.886721 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 3/4] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:43:57.368593 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-4bdd2ad8-26ab-45fb-9c9a-0d5511c5661f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "ram": 256}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:57.389273 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:43:57.389273 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 26 14:43:57.513356 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-4bdd2ad8-26ab-45fb-9c9a-0d5511c5661f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.628893 Jul 26 14:43:57.522333 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 2/5] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:43:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:43:57.743882 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-44571c0c-9988-40f6-93f3-3e4552f0797e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:43:57.748337 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:43:57.748337 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:43:57.751356 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.752240 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.753237 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell1:SELECT=3 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.754087 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:43:57.964696 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-44571c0c-9988-40f6-93f3-3e4552f0797e admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.441057 Jul 26 14:43:57.967434 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 4/6] 10.222.0.97 () {64 vars in 1335 bytes} [Tue Jul 26 14:43:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:00.227863 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-4bdd2ad8-26ab-45fb-9c9a-0d5511c5661f admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:00.228895 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-4bdd2ad8-26ab-45fb-9c9a-0d5511c5661f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 26 14:44:00.229290 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 3/7] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:00.912441 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5550f44c-3ad8-4a87-938d-fbb9c1f8106f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:00.932864 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:44:00.932864 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:44:01.061820 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-5550f44c-3ad8-4a87-938d-fbb9c1f8106f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.824834 Jul 26 14:44:01.062544 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 5/8] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:01.075764 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-2ae95c8f-5252-4cca-b6d7-e159f34b924a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:01.079100 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:44:01.079100 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: warnings.warn(msg) Jul 26 14:44:01.212596 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-2ae95c8f-5252-4cca-b6d7-e159f34b924a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141094 Jul 26 14:44:01.213120 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 4/9] 10.222.0.97 () {64 vars in 1335 bytes} [Tue Jul 26 14:44:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:03.444254 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5550f44c-3ad8-4a87-938d-fbb9c1f8106f admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:03.445338 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-5550f44c-3ad8-4a87-938d-fbb9c1f8106f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jul 26 14:44:03.445741 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 6/10] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:03.850204 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-2b91c734-7552-47d7-b5bc-ab5c42a1817b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:03.956257 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-2b91c734-7552-47d7-b5bc-ab5c42a1817b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504477 Jul 26 14:44:03.956737 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 5/11] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:03.969133 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-7932d605-7758-4573-a14e-723ca9df4580 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:04.065710 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-7932d605-7758-4573-a14e-723ca9df4580 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100869 Jul 26 14:44:04.068763 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 7/12] 10.222.0.97 () {64 vars in 1335 bytes} [Tue Jul 26 14:44:03 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:06.334782 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-2b91c734-7552-47d7-b5bc-ab5c42a1817b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:06.335832 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-2b91c734-7552-47d7-b5bc-ab5c42a1817b admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 26 14:44:06.336411 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 6/13] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:06.782700 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-a2b08cf7-3d60-4c4d-9806-041cdc96d5ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "vcpus": 2, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:06.889121 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-a2b08cf7-3d60-4c4d-9806-041cdc96d5ff admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546919 Jul 26 14:44:06.889699 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 8/14] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:06.903031 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-42e609ca-b72c-4211-9951-00cd5aece4aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:06.997740 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-42e609ca-b72c-4211-9951-00cd5aece4aa admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098422 Jul 26 14:44:06.998449 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 7/15] 10.222.0.97 () {64 vars in 1335 bytes} [Tue Jul 26 14:44:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:09.229679 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-a2b08cf7-3d60-4c4d-9806-041cdc96d5ff admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:09.230681 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-a2b08cf7-3d60-4c4d-9806-041cdc96d5ff admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 26 14:44:09.231075 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 9/16] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:09.693640 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:09.841914 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.604455 Jul 26 14:44:09.842486 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 8/17] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:44:09.855886 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-da6a48ab-2938-4ea6-90ce-29b62ef2e2d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:09.966787 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-da6a48ab-2938-4ea6-90ce-29b62ef2e2d1 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114757 Jul 26 14:44:09.967603 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 10/18] 10.222.0.97 () {64 vars in 1335 bytes} [Tue Jul 26 14:44:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:12.314256 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:12.315261 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 26 14:44:12.315709 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 9/19] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:12.763654 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-bbaff856-53ba-4027-b91a-e2833e5737ea admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:12.787684 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-bbaff856-53ba-4027-b91a-e2833e5737ea admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466006 Jul 26 14:44:12.788220 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 11/20] 10.222.0.97 () {60 vars in 1291 bytes} [Tue Jul 26 14:44:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 14:44:15.171057 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:15.172264 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9ff2c32b-5510-446e-b7a3-4df5a145946b admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jul 26 14:44:15.172718 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 10/21] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:15.652567 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-2292524b-a303-4a98-805d-8c26c0710403 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:15.767352 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-2292524b-a303-4a98-805d-8c26c0710403 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.587984 Jul 26 14:44:15.768221 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 12/22] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:15.782268 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-52027f3e-dd62-4a25-b30a-2ce5aa4c853a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:15.878858 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-52027f3e-dd62-4a25-b30a-2ce5aa4c853a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102061 Jul 26 14:44:15.879680 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 11/23] 10.222.0.97 () {64 vars in 1332 bytes} [Tue Jul 26 14:44:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:44:18.087265 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-2292524b-a303-4a98-805d-8c26c0710403 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:18.088341 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-2292524b-a303-4a98-805d-8c26c0710403 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 26 14:44:18.088775 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 13/24] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:44:18.496624 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-a4b67798-056c-4eee-8fe3-57970e7a4c0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "disk": 20, "swap": 0, "id": "2", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:18.592541 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-a4b67798-056c-4eee-8fe3-57970e7a4c0a admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.496919 Jul 26 14:44:18.593153 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 12/25] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:44:18.605424 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-82426e13-401c-4253-a971-40dd3dca32e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:18.882654 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-82426e13-401c-4253-a971-40dd3dca32e8 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280878 Jul 26 14:44:18.883362 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 14/26] 10.222.0.97 () {64 vars in 1332 bytes} [Tue Jul 26 14:44:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:21.159430 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-a4b67798-056c-4eee-8fe3-57970e7a4c0a admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:21.160487 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-a4b67798-056c-4eee-8fe3-57970e7a4c0a admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 26 14:44:21.160902 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 13/27] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:21.542917 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-b5dd10ba-7706-4d04-9737-226090a37d8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:21.882312 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-b5dd10ba-7706-4d04-9737-226090a37d8f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.715223 Jul 26 14:44:21.882799 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 15/28] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:21.894632 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-d43958b0-d666-40c2-87fe-3787c15955a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:22.091595 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-d43958b0-d666-40c2-87fe-3787c15955a3 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.200591 Jul 26 14:44:22.092180 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 14/29] 10.222.0.97 () {64 vars in 1332 bytes} [Tue Jul 26 14:44:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:24.386311 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-b5dd10ba-7706-4d04-9737-226090a37d8f admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:24.387395 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-b5dd10ba-7706-4d04-9737-226090a37d8f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 26 14:44:24.388240 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 16/30] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:24.877439 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-b406c864-9bc2-46ca-8fef-18b2c51af72f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "4", "vcpus": 4}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:24.884219 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:25.744807 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-b406c864-9bc2-46ca-8fef-18b2c51af72f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.349229 Jul 26 14:44:25.752843 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 15/31] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:44:25.757811 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-8d6d459b-f43f-47d1-ade1-43a3e80fad2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:25.877005 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-8d6d459b-f43f-47d1-ade1-43a3e80fad2b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123050 Jul 26 14:44:25.879543 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 17/32] 10.222.0.97 () {64 vars in 1332 bytes} [Tue Jul 26 14:44:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:28.202411 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-b406c864-9bc2-46ca-8fef-18b2c51af72f admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:28.204159 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-b406c864-9bc2-46ca-8fef-18b2c51af72f admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002751 Jul 26 14:44:28.204780 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 16/33] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:28.658630 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:28.752845 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.542093 Jul 26 14:44:28.756969 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 18/34] 10.222.0.97 () {64 vars in 1282 bytes} [Tue Jul 26 14:44:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:44:28.768875 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f64d28be-946a-4133-9d30-32441a112535 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:28.878946 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f64d28be-946a-4133-9d30-32441a112535 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116510 Jul 26 14:44:28.891753 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 17/35] 10.222.0.97 () {64 vars in 1332 bytes} [Tue Jul 26 14:44:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:44:48.912623 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:48.913629 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 26 14:44:48.914033 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 19/36] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:44:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:49.315981 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-0f425dae-5299-4c7f-83b3-a49d30b51033 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:49.333999 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-0f425dae-5299-4c7f-83b3-a49d30b51033 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414248 Jul 26 14:44:49.334532 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 18/37] 10.222.0.97 () {60 vars in 1291 bytes} [Tue Jul 26 14:44:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:50.397377 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:50.398424 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-95e0afcf-9a5c-4368-a04b-11e15bc4af30 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 26 14:44:50.398821 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 20/38] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:50.921416 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3eb85d67-83fb-43ed-8880-f2ffae68a030 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:50.927577 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-3eb85d67-83fb-43ed-8880-f2ffae68a030 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3eb85d67-83fb-43ed-8880-f2ffae68a030 admin admin] Request method failure captured: Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Host: 10.222.0.97 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi3_3iIgEtIMw8o1ri7AoBBR16Ak-9cQmWnAfvh4G4B7TUGpnO7KGzp39YJTDe_p0rAF8d9qLs7UHEVk3i62wUcdZGVDxqlwb23PPOB2-xy_IKE9A7LY4VEJoxVL00Pv1pJlZyE4huzVT5rD9O0YwfuiESmOeYj1raQgCOYM_Yai_K_rY Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Role: reader,admin,member Jul 26 14:44:50.930817 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Roles: reader,admin,member Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User: admin Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: method: > Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: exception: Flavor 42 could not be found. Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: action_args: {'id': '42'} Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:50.932454 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:50.933490 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:50.935239 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-3eb85d67-83fb-43ed-8880-f2ffae68a030 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:50.936411 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-3eb85d67-83fb-43ed-8880-f2ffae68a030 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395348 Jul 26 14:44:50.936411 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 19/39] 10.222.0.97 () {60 vars in 1190 bytes} [Tue Jul 26 14:44:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:50.942710 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6cb90253-340a-4941-9c05-51db26d0d11f admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:50.946747 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:44:50.965042 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6cb90253-340a-4941-9c05-51db26d0d11f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025973 Jul 26 14:44:50.965928 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 21/40] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:50.975322 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f59d8734-970e-46d4-bbf2-393bd4d50bd0 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:51.000665 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f59d8734-970e-46d4-bbf2-393bd4d50bd0 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028816 Jul 26 14:44:51.001217 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 20/41] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:51.011323 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-77a89ab1-a792-49db-a914-9c86ec56b8d9 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:51.017444 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-77a89ab1-a792-49db-a914-9c86ec56b8d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-77a89ab1-a792-49db-a914-9c86ec56b8d9 admin admin] Request method failure captured: Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.97 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi3_3iIgEtIMw8o1ri7AoBBR16Ak-9cQmWnAfvh4G4B7TUGpnO7KGzp39YJTDe_p0rAF8d9qLs7UHEVk3i62wUcdZGVDxqlwb23PPOB2-xy_IKE9A7LY4VEJoxVL00Pv1pJlZyE4huzVT5rD9O0YwfuiESmOeYj1raQgCOYM_Yai_K_rY Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Role: reader,admin,member Jul 26 14:44:51.020781 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,admin,member Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: method: > Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: exception: Flavor 42 could not be found. Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '42'} Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:51.022222 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:51.023284 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:51.024871 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-77a89ab1-a792-49db-a914-9c86ec56b8d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:51.026124 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-77a89ab1-a792-49db-a914-9c86ec56b8d9 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014808 Jul 26 14:44:51.026124 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 22/42] 10.222.0.97 () {60 vars in 1190 bytes} [Tue Jul 26 14:44:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:52.014505 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-f59d8734-970e-46d4-bbf2-393bd4d50bd0 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:52.015548 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-f59d8734-970e-46d4-bbf2-393bd4d50bd0 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002738 Jul 26 14:44:52.016001 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 21/43] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:52.542118 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5ea2f6eb-3e43-4c16-8ba1-8948104a563a admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:52.547951 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-5ea2f6eb-3e43-4c16-8ba1-8948104a563a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5ea2f6eb-3e43-4c16-8ba1-8948104a563a admin admin] Request method failure captured: Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.97 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi3_3jS_dMay9Bcs-EX7n64hO8tdHFROETQJahu6g3bisr5wKQb1BkbTAQ6pcCchO7hjpESFb_6g3QNt5lDczSXG1Pj19Pb9TaWQsH7bkLqkhQeQv42lwN1nZ-kg6GcFxhXCtPz8X7wgloCtGVN1icZ2SY9YBTgXFjAWMU4K-0CTDgTCg Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Role: reader,admin,member Jul 26 14:44:52.549443 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,admin,member Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: method: > Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: exception: Flavor 84 could not be found. Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '84'} Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:52.550788 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:52.552776 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.554095 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-5ea2f6eb-3e43-4c16-8ba1-8948104a563a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:52.555315 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-5ea2f6eb-3e43-4c16-8ba1-8948104a563a admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396327 Jul 26 14:44:52.555315 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 23/44] 10.222.0.97 () {60 vars in 1190 bytes} [Tue Jul 26 14:44:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:52.561228 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-765baecb-f6b4-4b51-a431-8d240e62e254 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:52.576096 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-765baecb-f6b4-4b51-a431-8d240e62e254 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019066 Jul 26 14:44:52.576656 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 22/45] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:52.586106 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6386d390-51e5-445a-8536-b5e44627bf92 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:52.602277 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6386d390-51e5-445a-8536-b5e44627bf92 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019678 Jul 26 14:44:52.602800 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 24/46] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:52.612681 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-b6f0426e-5b51-47ba-8f25-6152c94e0d70 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:52.617937 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-b6f0426e-5b51-47ba-8f25-6152c94e0d70 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-b6f0426e-5b51-47ba-8f25-6152c94e0d70 admin admin] Request method failure captured: Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Host: 10.222.0.97 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi3_3jS_dMay9Bcs-EX7n64hO8tdHFROETQJahu6g3bisr5wKQb1BkbTAQ6pcCchO7hjpESFb_6g3QNt5lDczSXG1Pj19Pb9TaWQsH7bkLqkhQeQv42lwN1nZ-kg6GcFxhXCtPz8X7wgloCtGVN1icZ2SY9YBTgXFjAWMU4K-0CTDgTCg Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Role: reader,admin,member Jul 26 14:44:52.619424 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Roles: reader,admin,member Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User: admin Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: method: > Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: exception: Flavor 84 could not be found. Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: action_args: {'id': '84'} Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:52.620949 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:52.622447 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:52.623590 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-b6f0426e-5b51-47ba-8f25-6152c94e0d70 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:52.624611 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-b6f0426e-5b51-47ba-8f25-6152c94e0d70 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011618 Jul 26 14:44:52.624611 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 23/47] 10.222.0.97 () {60 vars in 1190 bytes} [Tue Jul 26 14:44:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:53.592732 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6386d390-51e5-445a-8536-b5e44627bf92 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:53.593730 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6386d390-51e5-445a-8536-b5e44627bf92 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 26 14:44:53.594131 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 25/48] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:54.123531 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-6e0d6081-3d1d-4cba-8607-35b8012024c6 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:54.126915 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.wsgi [None req-6e0d6081-3d1d-4cba-8607-35b8012024c6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-6e0d6081-3d1d-4cba-8607-35b8012024c6 admin admin] Request method failure captured: Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept: application/json Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Accept-Encoding: gzip, deflate Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Connection: keep-alive Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Content-Length: 0 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Host: 10.222.0.97 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Openstack-System-Scope: None Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: User-Agent: python-novaclient Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Auth-Token: gAAAAABi3_3lNkNo64cL60hJJUZDX1e0PiDAZkBEd36mXZkqBpcUEuONJ-IRW9tfdRKu4aQ05y4eJKKCxbtbyQqIKm5pkvllIDtopVeZPaI4-p-lyFZXab9WiJK20Tu2iPtgoV7DVMIlivyIb_3xW1G9b0FoHGF7Mxlgf4pdrCQjnD0da7RT71o Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Id: None Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Domain-Name: None Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Identity-Status: Confirmed Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Is-Admin-Project: True Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Id: default Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Domain-Name: Default Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Project-Name: admin Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Role: reader,admin,member Jul 26 14:44:54.128441 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Roles: reader,admin,member Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant: admin Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-Tenant-Name: admin Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User: admin Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Id: default Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Domain-Name: Default Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: X-User-Name: admin Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: method: > Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: exception: Flavor 451 could not be found. Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: action_args: {'id': '451'} Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:54.130312 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:54.131351 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.132766 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-6e0d6081-3d1d-4cba-8607-35b8012024c6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:54.133989 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-6e0d6081-3d1d-4cba-8607-35b8012024c6 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395644 Jul 26 14:44:54.133989 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 24/49] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:44:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:54.141003 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-7bf73f9f-121e-4cf3-a399-882ad5a81db4 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:54.157465 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-7bf73f9f-121e-4cf3-a399-882ad5a81db4 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021125 Jul 26 14:44:54.158042 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 26/50] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:54.167774 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:54.182841 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018641 Jul 26 14:44:54.183364 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 25/51] 10.222.0.97 () {60 vars in 1210 bytes} [Tue Jul 26 14:44:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:44:54.193390 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e0297ad2-d29d-47df-81bc-b5d186dee58d admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:54.200141 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.wsgi [None req-e0297ad2-d29d-47df-81bc-b5d186dee58d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e0297ad2-d29d-47df-81bc-b5d186dee58d admin admin] Request method failure captured: Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept: application/json Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Accept-Encoding: gzip, deflate Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Connection: keep-alive Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Content-Length: 0 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Host: 10.222.0.97 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-Api-Version: compute 2.90 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Openstack-System-Scope: None Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: User-Agent: python-novaclient Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Auth-Token: gAAAAABi3_3lNkNo64cL60hJJUZDX1e0PiDAZkBEd36mXZkqBpcUEuONJ-IRW9tfdRKu4aQ05y4eJKKCxbtbyQqIKm5pkvllIDtopVeZPaI4-p-lyFZXab9WiJK20Tu2iPtgoV7DVMIlivyIb_3xW1G9b0FoHGF7Mxlgf4pdrCQjnD0da7RT71o Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Id: None Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Domain-Name: None Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Identity-Status: Confirmed Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Is-Admin-Project: True Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Id: default Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Domain-Name: Default Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Project-Name: admin Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Role: reader,admin,member Jul 26 14:44:54.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Roles: reader,admin,member Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_011581630bbe4c60a042395d12032595"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/011581630bbe4c60a042395d12032595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/011581630bbe4c60a042395d12032595"}]}] Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant: admin Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Id: 011581630bbe4c60a042395d12032595 Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-Tenant-Name: admin Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User: admin Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Id: default Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Domain-Name: Default Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Id: 11071bdab076477385007310e6ab9852 Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: X-User-Name: admin Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: method: > Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: exception: Flavor 451 could not be found. Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: action_args: {'id': '451'} Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:44:54.203176 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:54.204208 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: ERROR nova.api.openstack.wsgi Jul 26 14:44:54.205486 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-e0297ad2-d29d-47df-81bc-b5d186dee58d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:44:54.206769 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-e0297ad2-d29d-47df-81bc-b5d186dee58d admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013333 Jul 26 14:44:54.206769 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 27/52] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:44:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 14:44:55.188693 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:55.189705 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 26 14:44:55.190129 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 26/53] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:44:55.723133 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-a314a04b-264b-42ae-957e-05f3e4d46102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:55.898753 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-a314a04b-264b-42ae-957e-05f3e4d46102 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.567105 Jul 26 14:44:55.899301 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 28/54] 10.222.0.97 () {64 vars in 1235 bytes} [Tue Jul 26 14:44:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:44:56.891653 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:56.892664 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 26 14:44:56.893062 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 27/55] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:57.424861 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-b0c68e27-03bb-4c7d-943b-96cc33aa2552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:57.509988 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-b0c68e27-03bb-4c7d-943b-96cc33aa2552 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.476161 Jul 26 14:44:57.510548 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 29/56] 10.222.0.97 () {64 vars in 1235 bytes} [Tue Jul 26 14:44:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 14:44:58.482802 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:44:58.483929 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 26 14:44:58.484326 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 28/57] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:44:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:44:59.016194 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-c5627f80-a0a6-40ce-ae5a-de2cb87876f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:44:59.097416 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-c5627f80-a0a6-40ce-ae5a-de2cb87876f3 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.473366 Jul 26 14:44:59.097974 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 30/58] 10.222.0.97 () {64 vars in 1235 bytes} [Tue Jul 26 14:44:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:45:00.081244 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:00.082247 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 26 14:45:00.082636 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 29/59] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:00.627027 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-6155212e-8083-4da6-83d0-338a39fcb179 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:45:00.766641 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-6155212e-8083-4da6-83d0-338a39fcb179 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.545013 Jul 26 14:45:00.769435 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 31/60] 10.222.0.97 () {64 vars in 1235 bytes} [Tue Jul 26 14:45:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:45:01.744580 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:01.746107 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 26 14:45:01.746515 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 30/61] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:02.272285 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-969dc717-6855-4ddf-8e42-31435079c203 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:02.292994 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-969dc717-6855-4ddf-8e42-31435079c203 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409005 Jul 26 14:45:02.294243 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 32/62] 10.222.0.97 () {60 vars in 1202 bytes} [Tue Jul 26 14:45:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:45:54.507914 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.508920 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-c0858e95-f85b-4ade-b53c-e684090af5eb admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Jul 26 14:45:54.509306 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 31/63] 10.222.0.97 () {54 vars in 930 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:45:54.519579 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:54.901741 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-baca2055-5ea8-437c-aaba-7c655c855cad admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.921749 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-baca2055-5ea8-437c-aaba-7c655c855cad admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406589 Jul 26 14:45:54.922221 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 33/64] 10.222.0.97 () {60 vars in 1291 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:45:54.943504 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG dbcounter [-] [110318] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:45:54.947827 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-748897d2-a1a9-4475-a96b-b0553de1c9c7 admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.955332 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-748897d2-a1a9-4475-a96b-b0553de1c9c7 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013366 Jul 26 14:45:54.957339 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 32/65] 10.222.0.97 () {60 vars in 1282 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:54.968056 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-3b552302-9af1-4833-b0fa-2d398856630d admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.975770 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-3b552302-9af1-4833-b0fa-2d398856630d admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011251 Jul 26 14:45:54.976886 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 34/66] 10.222.0.97 () {60 vars in 1285 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:54.987973 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:54.995827 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011299 Jul 26 14:45:54.996348 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 33/67] 10.222.0.97 () {60 vars in 1285 bytes} [Tue Jul 26 14:45:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:45:55.008038 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-0d1843c6-65b9-4ce3-bd6f-85f4acb25126 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:45:55.015686 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-0d1843c6-65b9-4ce3-bd6f-85f4acb25126 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011187 Jul 26 14:45:55.016203 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 35/68] 10.222.0.97 () {60 vars in 1282 bytes} [Tue Jul 26 14:45:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:49:38.613261 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:38.614270 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 26 14:49:38.614668 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 34/69] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:38.756771 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=6 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:38.914904 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:38.917248 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:49:38.917248 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:49:38.918453 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:38.918891 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:38.919821 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:38.920247 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:38.955126 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-728fe016-3459-4d8c-8daf-58c9316b0d92 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200502 Jul 26 14:49:38.955721 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 36/70] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:49:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:49:39.781117 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:39.782152 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 26 14:49:39.782542 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 35/71] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:49:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:39.973917 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:39.976344 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:49:39.976344 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:49:39.977541 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:39.977978 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:39.978756 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:39.979182 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:39.999032 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-30f1d518-1f57-4982-a66e-31f343649507 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076309 Jul 26 14:49:39.999594 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 37/72] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:49:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 14:49:51.270437 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:51.271514 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 26 14:49:51.271912 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 36/73] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:49:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:51.418327 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell0:SELECT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:51.419061 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_cell1:SELECT=4 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:51.419698 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG dbcounter [-] [110317] Writing DB stats nova_api:SELECT=8 {{(pid=110317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:49:51.471741 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:51.474794 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:49:51.474794 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:49:51.476036 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:51.482088 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:51.482088 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:51.482088 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:51.503531 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-1d276d2e-97f7-4df4-b8b2-3276d0f31163 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089542 Jul 26 14:49:51.504094 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 38/74] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:49:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:49:52.334264 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: DEBUG nova.api.openstack.wsgi [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] Calling method '>' {{(pid=110318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:52.335286 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: INFO nova.api.openstack.requestlog [None req-9e90d83f-d907-4153-a771-6403a534fccf admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 26 14:49:52.335710 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: [pid: 110318|app: 0|req: 37/75] 10.222.0.97 () {56 vars in 1074 bytes} [Tue Jul 26 14:49:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:49:52.527078 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG nova.api.openstack.wsgi [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] Calling method '>' {{(pid=110317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:49:52.529507 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 14:49:52.529507 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: warnings.warn(msg) Jul 26 14:49:52.530693 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:52.531134 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:52.531937 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:49:52.532362 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: DEBUG oslo_concurrency.lockutils [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:49:52.554090 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: INFO nova.api.openstack.requestlog [None req-1295f5f5-1597-4169-a4bf-1ded9c076536 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078495 Jul 26 14:49:52.554577 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: [pid: 110317|app: 0|req: 39/76] 10.222.0.97 () {60 vars in 1193 bytes} [Tue Jul 26 14:49:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 14:50:52.862898 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: Tue Jul 26 14:50:52 2022 - graceful shutdown triggered... Jul 26 14:50:52.863011 dv-cinder-851030-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 14:50:52.864264 dv-cinder-851030-1-iscsi devstack@n-api.service[110318]: Gracefully killing worker 2 (pid: 110318)... Jul 26 14:50:52.864659 dv-cinder-851030-1-iscsi devstack@n-api.service[110317]: Gracefully killing worker 1 (pid: 110317)... Jul 26 14:50:53.864647 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: worker 1 buried after 1 seconds Jul 26 14:50:53.865110 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: worker 2 buried after 1 seconds Jul 26 14:50:53.865110 dv-cinder-851030-1-iscsi devstack@n-api.service[110316]: goodbye to uWSGI. Jul 26 14:50:53.866249 dv-cinder-851030-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 14:50:53.866808 dv-cinder-851030-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 14:50:53.869697 dv-cinder-851030-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 14:50:53.879815 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 14:50:53 2022] *** Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: nodename: dv-cinder-851030-1-iscsi Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: machine: x86_64 Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: clock source: unix Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: pcre jit disabled Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: detected number of CPU cores: 4 Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: current working directory: / Jul 26 14:50:53.881833 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: detected binary path: /usr/bin/uwsgi-core Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: your processes number limit is 47680 Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: your memory page size is 4096 bytes Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: detected max file descriptor number: 2048 Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: lock engine: pthread robust mutexes Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: thunder lock: enabled Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 14:50:53.882488 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 14:50:53.922086 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: Python main interpreter initialized at 0x56164af8b9c0 Jul 26 14:50:53.922086 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: python threads support enabled Jul 26 14:50:53.922086 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: your server socket listen backlog is limited to 100 connections Jul 26 14:50:53.922086 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: your mercy for graceful operations on workers is 90 seconds Jul 26 14:50:53.922452 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 14:50:53.922452 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: *** Operational MODE: preforking *** Jul 26 14:50:53.922695 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: *** uWSGI is running in multiple interpreter mode *** Jul 26 14:50:53.922695 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: spawned uWSGI master process (pid: 124877) Jul 26 14:50:53.922903 dv-cinder-851030-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 14:50:53.923883 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: spawned uWSGI worker 1 (pid: 124888, cores: 1) Jul 26 14:50:53.923883 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: spawned uWSGI worker 2 (pid: 124889, cores: 1) Jul 26 14:50:53.924077 dv-cinder-851030-1-iscsi devstack@n-api.service[124877]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 14:50:54.596520 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:50:54.607205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 14:50:55.758659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:50:55.758659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: from cryptography.utils import int_from_bytes Jul 26 14:50:55.759360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:50:55.759360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: from cryptography.utils import int_from_bytes Jul 26 14:50:55.772917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:50:55.772917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: from cryptography.utils import int_from_bytes Jul 26 14:50:55.773370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 14:50:55.773370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: from cryptography.utils import int_from_bytes Jul 26 14:50:58.194965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:50:58.195774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:50:58.195876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:50:58.196176 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:50:58.196436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:50:58.196834 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.197384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.197475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.197780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.198107 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.198426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.198746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.199069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.199435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.199688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.200002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.200324 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851030-1-iscsi {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.200645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.201129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.201495 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.201823 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.202134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.202460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.202770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.203276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.205980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.206311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.206519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.206917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851030-1-iscsi {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.207237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.207578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.207899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.208319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.208642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.208955 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.209268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.209594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.209914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.210236 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.210562 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.210892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.211205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.211609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.211928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.212231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.212551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.212870 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.213167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.213431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.213733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.214056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.214378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.214703 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.214960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.215214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.215561 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.215886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.216193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.216504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.216818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.217674 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.217988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.218295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.218606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.218914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.219235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.219588 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.219914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.220226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.220547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.220959 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.221214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.221522 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.221869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.222193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.222502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.222821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.223140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.223465 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.223777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.224087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.224408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.224746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.225052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.225306 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.225608 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.225915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.226231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.226538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.226845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.227152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.227482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.227794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.228103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.228412 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.228717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.229025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.229331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.229639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.229944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.230249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.230571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.230893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.231202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.231531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.231840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.232148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.232463 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.233354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.233666 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.233992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.234299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.234605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.234925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.235235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.235570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.235893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.236196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.236503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.236821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.237128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.237441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.237744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.238049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.238616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.238883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 14:50:58.239342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.239467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 14:50:58.239557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.239557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.239784 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 14:50:58.239864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.240042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 14:50:58.240186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.240435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.240748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.240881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 14:50:58.241057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.241364 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.241549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.241712 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.241876 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.242026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.242202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.242362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.242516 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.242679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.242854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.243023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.243174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.243323 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.243591 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.243701 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.243923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.244039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.244257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.244381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.244517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.244641 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.244894 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.245207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.245319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.245519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.245646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851030-1-iscsi {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.245827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.245958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.246337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.246443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.246658 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.246766 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.247045 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.247508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.247762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.247852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.247933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.248017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.248098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.248222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.248924 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.249048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.249269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.249545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.249707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.249879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.250037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.250190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.250383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.250559 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.250724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.250870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.251013 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.251168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.251327 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.251518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.251678 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.251824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.251976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.252332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.252487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.252641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851030-1-iscsi {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.252799 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.252955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.253110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.253263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.253409 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.253552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.253697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.253697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.254008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.254241 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.254402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.254546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.254794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.255204 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.255374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.255557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.255714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.255867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.256012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.256175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.256326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.256471 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.256622 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.256768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.256913 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.257072 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.257234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.257379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.257523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.257667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.257809 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.257809 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.258098 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.258241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.258396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.258548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.259545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.259716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.259883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.260042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.260204 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.260357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.260503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.260654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.260808 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.260968 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.261124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.261124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.261407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.261407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.261706 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.261865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.262020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.262185 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.262570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.262724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.262890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.263051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.263224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.264536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.264794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.265054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.265412 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.265575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.265730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.265877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.266134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.266289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.266451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.266605 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.266756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.266908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.267063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.267216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.267378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.267615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.267764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.267915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.268067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.268220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.268388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.268542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.268688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.268688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.268976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.268976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.269266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.269448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.269690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.269842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.269995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.270155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.270300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.270452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.270606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.270751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.270895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.271054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.271312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.271486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.271647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.271792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.271948 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.272112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.272266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.272444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.272885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.273051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.273218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.273388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.273545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.273691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.273835 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.273996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.274148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.274293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.274451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.274603 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.274782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.274934 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.275175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.275357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.275629 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.275789 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.275935 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.276078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.276232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.276414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.276560 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.276705 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.276857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.277009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.277153 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.277312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.277457 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.277601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.277751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.277897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.278051 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.278219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.278366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.278510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.278660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.278812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.278974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.279127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.279279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.279503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.279677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.279908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.280070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.280227 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.280382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.280534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.280691 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.280850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.281004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.281156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.281308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.281468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.281621 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.281773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.281918 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.282071 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.282232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.283221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.283388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.283561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.283708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.283852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.283997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.284165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.284319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.284471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.284616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.284767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.284927 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.285083 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.285325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.285478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.285650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.285801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.285956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.286101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.286246 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.286398 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.286543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.286694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.286854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.287000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.287161 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.287314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.287314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.287636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.287791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.287945 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.288090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.288242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.288395 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.288555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.288700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.288844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.288996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.289164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.289324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.289480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.289633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.289785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.290013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.290173 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.290325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 14:50:58.290482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.290635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.290788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.290941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.291872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292016 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292327 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.292798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.293170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.293401 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.293567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.293727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.293880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294545 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.294863 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.295015 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.295564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.295756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.295921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296224 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296550 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296703 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.296861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297013 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297323 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.297965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298267 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298743 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.298904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.299942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.300181 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.300422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.300584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.300744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.300897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301784 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.301954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.302113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.302276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.302436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.302595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.302771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.303163 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.303329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.303517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.303688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.303847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304153 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.304966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.305128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.305298 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.305547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.305713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.305873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306521 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.306850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.307868 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.308020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.308468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.308645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.308798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.308949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309717 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.309873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.310031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.310202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.310427 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.310600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.311281 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.311454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.311627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.311792 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.311943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312108 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.312908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.313083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.313726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.313890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.314864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.315937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316265 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316747 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.316907 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.317991 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318149 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318307 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318476 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.318949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319107 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.319991 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320077 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320267 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320692 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.320964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.321965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322239 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322425 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322591 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.322941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323488 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323573 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.323916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324242 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324425 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.324980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325318 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325412 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325496 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325889 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.325961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326590 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326890 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.326984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327064 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327288 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327476 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.327992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328406 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328560 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.328919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.329486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.330904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331597 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.331975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332063 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332424 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332593 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332685 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.332962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333719 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.333928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334010 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334807 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.334892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335389 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335724 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.335818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336038 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336356 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.336992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337144 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337441 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.337876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338029 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.338915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339213 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.339782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340626 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340760 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.340943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341255 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341574 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341741 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.341895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.342604 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.342768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.342923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.343073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.343233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.343386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.343580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.343968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344138 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344457 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.344951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.345104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.345270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.345424 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.345594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.345884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346602 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.346926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347098 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.347901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348413 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.348872 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349676 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.349979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.350149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.350303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.350455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.350613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.350772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351223 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.351947 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352100 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352260 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.352919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.353072 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.353232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.353397 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.353568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.353737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354585 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354747 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.354967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.355268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.355268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.355650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.355827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356411 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.356981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.357135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.357135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.357461 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.357681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.357843 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358799 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.358972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359805 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.359958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360453 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360613 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.360951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361197 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.361866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.362164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.362329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.362480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.362632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.362881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.363044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.363196 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.363630 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.363804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.364208 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.364384 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.364543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.364695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.364848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.365012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.365012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.365995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.365995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.366957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.367043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.367136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.367236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.367329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.367329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.379747 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.379858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.379858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380404 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380574 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380665 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380855 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.380948 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.381983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382150 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382334 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382334 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.382973 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383583 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.383919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384469 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.384948 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385520 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.385928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.386998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387428 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.387869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388566 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.388733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.389985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390077 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.390958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391121 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391206 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391846 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391926 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.391998 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392082 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392805 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392891 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.392973 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393056 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393415 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.393953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394225 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.394952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395572 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395799 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.395959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.396058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.396143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.396938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397571 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.397945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398095 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398166 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398260 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.398934 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399836 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.399921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400465 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400649 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400734 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.400824 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.401958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402597 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.402994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.403218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.403313 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.403546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.403657 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.403883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404277 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.404854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405084 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405405 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405511 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.405842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.406803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407124 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.407800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.408002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.408169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.408319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.408484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.408795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.409112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.409403 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.409519 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.409721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.409828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410343 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.410967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.411068 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.411274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.411368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418799 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.418928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.419366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.419529 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.419659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.419781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.419963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420891 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.420978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421874 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.421954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422298 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422718 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422804 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.422981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423260 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423357 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.423916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424103 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424230 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.424991 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425568 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425747 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.425938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426302 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426397 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426495 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426597 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.426988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427759 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427846 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.427931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.428916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.429979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430447 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.430961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431053 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.431897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.432052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.432450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.432552 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.432785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.432882 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433419 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433528 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433729 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.433830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434466 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.434774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435004 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435112 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.435837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436711 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.436848 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437310 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437649 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.437822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438149 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.438936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439071 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439739 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.439903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440195 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440813 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.440959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.441867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.442980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.443188 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.443317 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.443553 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.443881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.444203 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.444331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.444525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.444654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.444897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445061 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.445818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.446811 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.447205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.447558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.447877 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.448210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.448539 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.448865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.449187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.449526 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.449844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.450244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.450564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.450881 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.451197 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.452468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.452613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.452613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.452835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.452970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453571 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.453964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.454176 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.454298 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.454507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.454637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.454860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.455963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.456184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.456308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.457984 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458107 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458563 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.458917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.459967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.460088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.460376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.460503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.460680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.460816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461322 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461442 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461638 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.461946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.462068 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.462192 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124888) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:50:58.462531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.462934 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.463333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.463752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.464150 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.464543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.464955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.465541 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.465852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.466241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.466640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.467103 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.467611 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.468263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.468760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.469158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.469551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.469947 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.470336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.470744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.471133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.471562 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.471999 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.472460 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.472946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.473384 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.473736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.474230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.474635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.475032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.475500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.475899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.476301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.476939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.477458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.477829 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.478425 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.478840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.479233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.479649 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.480040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.480448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.480851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.481243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.481637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.482034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.482428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.483473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.483877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.484291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.484689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.485082 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.485478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.485877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.486272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.486703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.487128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.487557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.487955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.488770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.489168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.489577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.489972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.490368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.490767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.491163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.491607 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.492005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.492393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.492907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.493336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.493735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.494141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.494550 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.494956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.495362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.495775 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.496172 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.496564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.496977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.497433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.497803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.498376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.498763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.499153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.499685 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.500094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.500500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.501022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.501337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.501794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.502205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.502609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.502996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.503385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.503786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.504177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.504562 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.504949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.505349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.505736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.506125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.506510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.506901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.507284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.507814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.508073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.508554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.508864 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.509279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.509695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.510108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.510521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.510911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.511316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.511802 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.512208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.512686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.513014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.513407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.514335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.514730 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.515125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.515545 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.515954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.516346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.516738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.517151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.517553 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.517938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.518336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.518736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.519124 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.520771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.520771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.520771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.520771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.521305 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.521437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.521803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.522195 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.522593 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.522983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.523374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.523796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.524028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO dbcounter [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Registered counter for database nova_api Jul 26 14:50:58.524250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.524659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.525066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.525469 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.525878 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.526355 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.526714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.527127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.527551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.528078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.528343 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.528906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.529107 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 14:50:58.529587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 14:50:58.550864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_db.sqlalchemy.engines [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.557773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writer thread running {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.593182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO dbcounter [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Registered counter for database nova_api Jul 26 14:50:58.614271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_db.sqlalchemy.engines [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.614814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.context [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b94e0a29-23eb-489d-a693-b18b7475483a(cell1) {{(pid=124888) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:50:58.619016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.620642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.621370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writer thread running {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.621488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.624362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.626402 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO dbcounter [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Registered counter for database nova_cell0 Jul 26 14:50:58.630605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO dbcounter [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Registered counter for database nova_cell1 Jul 26 14:50:58.637995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_db.sqlalchemy.engines [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.642242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_db.sqlalchemy.engines [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.651525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writer thread running {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.653140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writer thread running {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.681029 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.context [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b94e0a29-23eb-489d-a693-b18b7475483a(cell1) {{(pid=124889) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 14:50:58.685227 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.687462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.688287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:50:58.690326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:50:58.692513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO dbcounter [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Registered counter for database nova_cell0 Jul 26 14:50:58.696585 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO dbcounter [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Registered counter for database nova_cell1 Jul 26 14:50:58.704131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_db.sqlalchemy.engines [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.705972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_db.sqlalchemy.engines [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.711003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writer thread running {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.801060 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO dbcounter [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Registered counter for database nova_cell0 Jul 26 14:50:58.807611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_db.sqlalchemy.engines [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124888) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.812236 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writer thread running {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.854362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writer thread running {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:58.865352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO dbcounter [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Registered counter for database nova_cell0 Jul 26 14:50:58.872168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_db.sqlalchemy.engines [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 14:50:58.876587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writer thread running {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 14:50:59.136139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: WARNING keystonemiddleware.auth_token [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:50:59.145128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: WARNING keystonemiddleware.auth_token [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:50:59.205588 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: WARNING keystonemiddleware.auth_token [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:50:59.213333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: WARNING keystonemiddleware.auth_token [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:50:59.489668 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: WARNING keystonemiddleware.auth_token [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:50:59.496354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: WARNING keystonemiddleware.auth_token [None req-e2810d26-bf99-430e-b3fe-6f8f5b614cfc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:50:59.502259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56164af8b9c0 pid: 124888 (default app) Jul 26 14:50:59.561148 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: WARNING keystonemiddleware.auth_token [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 14:50:59.567612 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: WARNING keystonemiddleware.auth_token [None req-22365a37-0d7a-4b37-87fa-3ce46ee997c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 14:50:59.573174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56164af8b9c0 pid: 124889 (default app) Jul 26 14:51:43.156614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:43.157664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:43.158871 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:43.161978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:44.268451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f9039378-b16b-4994-af04-d1e51f3dc686 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Action: 'create', calling method: .version_select at 0x7f97e82e1940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1691546643", "metadata": {"Type": "work"}}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:46.857427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f9039378-b16b-4994-af04-d1e51f3dc686 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.726367 Jul 26 14:51:46.858380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 1/1] 10.222.0.97 () {60 vars in 1156 bytes} [Tue Jul 26 14:51:43 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3729 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 14:51:46.879484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:46.882680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:46.886714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:46.887906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:51:47.501366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2eee4782-4b24-4a7a-8a46-d3e0dbea2370 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e82b33a0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:48.220366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2eee4782-4b24-4a7a-8a46-d3e0dbea2370 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 200 len: 353 microversion: 2.1 time: 1.350325 Jul 26 14:51:48.221813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 1/2] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:46 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 353 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:49.236704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2f9d950c-19a3-41c8-9838-cf1b3a8c458d tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e8136790>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:49.474594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2f9d950c-19a3-41c8-9838-cf1b3a8c458d tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 200 len: 354 microversion: 2.1 time: 0.242889 Jul 26 14:51:49.485874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 2/3] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:49 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:49.496873 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7eec553d-31b6-43f6-8887-79ceb3982a2a tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e81788b0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:51.177015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7eec553d-31b6-43f6-8887-79ceb3982a2a tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 200 len: 354 microversion: 2.1 time: 1.690123 Jul 26 14:51:51.188024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 2/4] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:49 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 354 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:51.193721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a4b6559c-795e-4844-b4b7-4158090304e4 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e8136e50>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:51.697402 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a4b6559c-795e-4844-b4b7-4158090304e4 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 202 len: 0 microversion: 2.1 time: 0.508149 Jul 26 14:51:51.701113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 3/5] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 14:51:51 2022] DELETE /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:51:51.709770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5c1494b9-df69-4263-8c5c-deb26f943c1a tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e8178e50>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:51.847554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5c1494b9-df69-4263-8c5c-deb26f943c1a tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 200 len: 353 microversion: 2.1 time: 0.144526 Jul 26 14:51:51.848559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 3/6] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:51 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:52.860861 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4576d43f-4241-4e10-a48f-2fb47454df4e tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e814d550>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:52.954192 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4576d43f-4241-4e10-a48f-2fb47454df4e tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 200 len: 353 microversion: 2.1 time: 0.097007 Jul 26 14:51:52.954757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 4/7] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:52 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:51:53.307157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-654a9e42-1b2a-43e4-9d03-3da4bc45a9fb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: .version_select at 0x7f97e8178ca0>, body: {"keypair": {"name": "tempest-keypair-2040899823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBthFkIxqZNTX3uCH82YR9oHBSGMQN/yWSAZ2rcQ3Dhkanwo2rQB+RXex34lbxeTDGpb2vtr34jc6MNxnzVuT9zmN2rUXrHjRm1nhfEtQnyw2UWTUod/LL01uJX/WwyO5g=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:53.357348 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-654a9e42-1b2a-43e4-9d03-3da4bc45a9fb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:51:53.382658 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-654a9e42-1b2a-43e4-9d03-3da4bc45a9fb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:51:53.625345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-654a9e42-1b2a-43e4-9d03-3da4bc45a9fb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.527521 Jul 26 14:51:53.626042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 4/8] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:51:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:53.968612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b4804e01-f226-401d-a997-bb059c374a67 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Calling method '.version_select at 0x7f97e8136b80>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:51:54.996354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-b4804e01-f226-401d-a997-bb059c374a67 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] HTTP exception thrown: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b4804e01-f226-401d-a997-bb059c374a67 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Request method failure captured: Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 HTTP/1.1 Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_9_I5guZWa9ymr2-MemVUnsEAemwiHxQtQaqZ_sE71t_TosWIARmZpUBsjNYbi7766c_wp6u30u8nU9UjngzTnUVgnKFtFmMXcWzaNksNJQ9KHsocFjj4X22wTzKm_YGveFSibIOL8Gh7AAfj7xg6LpQLqq9qXsG6ilb-eYOtdfL5U Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 6a4d0de164894881bcec30ff989a283b Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesGetTestJSON-1086705066 Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:51:55.001055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_6a4d0de164894881bcec30ff989a283b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/6a4d0de164894881bcec30ff989a283b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/6a4d0de164894881bcec30ff989a283b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/6a4d0de164894881bcec30ff989a283b"}]}] Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesGetTestJSON-1086705066 Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 6a4d0de164894881bcec30ff989a283b Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesGetTestJSON-1086705066 Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesGetTestJSON-1086705066-project Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 904ae63d554f4435ad5f7702bea2d3ba Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesGetTestJSON-1086705066-project Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '3a35c82b-c487-4b37-ad1a-76b62737bc72'} Jul 26 14:51:55.002430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. (HTTP 404) (Request-ID: req-785c5cb7-4588-4454-b0b5-80365b3790d1) Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:55.003831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 14:51:55.005381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 14:51:55.007922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b4804e01-f226-401d-a997-bb059c374a67 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] Returning 404 to user: Volume 3a35c82b-c487-4b37-ad1a-76b62737bc72 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:51:55.010007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b4804e01-f226-401d-a997-bb059c374a67 tempest-VolumesGetTestJSON-1086705066 tempest-VolumesGetTestJSON-1086705066-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72" status: 404 len: 109 microversion: 2.1 time: 1.040913 Jul 26 14:51:55.021378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 5/9] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:51:53 2022] GET /compute/v2.1/os-volumes/3a35c82b-c487-4b37-ad1a-76b62737bc72 => generated 109 bytes in 1055 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:51:58.563188 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f63bc77d-09cb-4d60-a35d-60ebe9257372 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: .version_select at 0x7f97e811b4c0>, body: {"keypair": {"name": "tempest-keypair-807930728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMtxbZvPuuAm4lFoj9fKYWPs60KfffRaMhsDdywMAa3vuerVPKahw4b7EXHyOzJF+FAyp0uBWU5TccbOp0J/Mt0v/s4bZQumEfW/caC1JcoV7AjVrN4+SDYL5O0NMjO/9Q=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:58.606928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-f63bc77d-09cb-4d60-a35d-60ebe9257372 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:51:58.619710 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-f63bc77d-09cb-4d60-a35d-60ebe9257372 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for user e0615d20057342cfbd16aa0ec94d1979 and project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:51:58.762033 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f63bc77d-09cb-4d60-a35d-60ebe9257372 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.648859 Jul 26 14:51:58.762632 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 5/10] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:51:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:51:59.602494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-701248268", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "networks": [{"uuid": "8e81120a-d472-43d2-a7db-69cbb3be13c6"}]}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:59.735011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-642866130", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:51:59.752114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] validate_networks() for [('8e81120a-d472-43d2-a7db-69cbb3be13c6', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:51:59.912782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] validate_networks() for [('0f1306c7-31e7-49e9-8b79-d9c630497063', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:02.057083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:02.058997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:02.058997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:02.058997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:02.058997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:02.080999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.081451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.083119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.083301 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.152708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Getting quotas for project ca1bc66d9e5446758a759063544ae3e7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:02.170826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Getting quotas for user 713d2a0f610d4296887b6ab9664ae5e6 and project ca1bc66d9e5446758a759063544ae3e7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:02.186832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:02.190060 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:02.321320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:02.321879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:02.322528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:02.322955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:02.323382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:02.343043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.350908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.350908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:02.350908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:02.374904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:02.381623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for user 19c0408b4321495eabd4738bbb8b711b and project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:02.395439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:02.398518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:02.476569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d386f1c7-228a-4046-b4e2-9bef9c86ba07 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.245374 Jul 26 14:52:02.477616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 6/11] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:02.526206 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1848324827", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0"}], "security_groups": [{"name": "tempest-securitygroup--342152317"}], "key_name": "tempest-keypair-2040899823", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:02.718925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4394a833-70e5-499b-8cfd-43d07181d098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.270227 Jul 26 14:52:02.720229 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 6/12] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:51:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:02.736792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7e41864f-238d-415d-85d4-e3cee0bb7778 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:02.736792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7e41864f-238d-415d-85d4-e3cee0bb7778 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:02.836826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] validate_networks() for [('4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:03.382182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7e41864f-238d-415d-85d4-e3cee0bb7778 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:03.428827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7e41864f-238d-415d-85d4-e3cee0bb7778 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1214 microversion: 2.1 time: 0.707167 Jul 26 14:52:03.449726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 7/13] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:02 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1214 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:03.468005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-63145f65-db2d-4b39-8569-65e1119985a3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:03.468005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-63145f65-db2d-4b39-8569-65e1119985a3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:03.618728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-63145f65-db2d-4b39-8569-65e1119985a3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:03.628229 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-63145f65-db2d-4b39-8569-65e1119985a3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1221 microversion: 2.1 time: 0.171681 Jul 26 14:52:03.631924 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 8/14] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:03 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:03.895809 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1403532971", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:04.013918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] validate_networks() for [('0f1306c7-31e7-49e9-8b79-d9c630497063', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:04.126036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:04.132222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:04.132222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:04.132222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:04.132222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:04.155045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:04.155783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:04.156744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:04.157643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:04.193059 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:04.198413 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:04.213199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:04.215240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:04.501577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f6b49af0-8edd-4447-acf5-2650d261d205 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.000067 Jul 26 14:52:04.510031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 7/15] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:52:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:04.515740 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-710720197", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02c3d9d5-b71e-4ad5-9373-5d17164e8aec"}], "security_groups": [{"name": "tempest-securitygroup--895331267"}], "key_name": "tempest-keypair-807930728", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:04.739750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] validate_networks() for [('02c3d9d5-b71e-4ad5-9373-5d17164e8aec', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:52:04.958855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:04.959346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:04.960637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:04.967109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:04.967109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:04.976278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:04.977106 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:04.978128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:04.978828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:05.006328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:05.013707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for user 19c0408b4321495eabd4738bbb8b711b and project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:05.030741 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:05.034030 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:05.362845 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-77062ca9-3dbc-4859-a1da-148072ebaea1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.469664 Jul 26 14:52:05.364520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 9/16] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:52:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:05.390097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-eb641e79-da59-44e8-b78c-5b8609eb6ea0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:05.391240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-eb641e79-da59-44e8-b78c-5b8609eb6ea0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:05.583785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-eb641e79-da59-44e8-b78c-5b8609eb6ea0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:05.594023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-eb641e79-da59-44e8-b78c-5b8609eb6ea0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1214 microversion: 2.1 time: 0.216700 Jul 26 14:52:05.594863 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 10/17] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:05 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1214 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:05.621053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c0acd7a7-d79d-405f-a4ce-85763b9a5978 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:05.623292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c0acd7a7-d79d-405f-a4ce-85763b9a5978 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:05.756572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c0acd7a7-d79d-405f-a4ce-85763b9a5978 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:05.766467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c0acd7a7-d79d-405f-a4ce-85763b9a5978 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1242 microversion: 2.1 time: 0.155474 Jul 26 14:52:05.771444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 11/18] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:05 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:05.795299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8b2d0b49-eefc-4bad-b730-1974f4635cf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:05.796561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8b2d0b49-eefc-4bad-b730-1974f4635cf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:05.904051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8b2d0b49-eefc-4bad-b730-1974f4635cf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:05.912712 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8b2d0b49-eefc-4bad-b730-1974f4635cf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1222 microversion: 2.1 time: 0.138465 Jul 26 14:52:05.927837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 12/19] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:05 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:05.934462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:52:05.934987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:52:05.941452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:52:05.941452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:52:05.941452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:52:05.959144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:05.959780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:05.962575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:05.963261 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:06.018016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:52:06.023216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for user e0615d20057342cfbd16aa0ec94d1979 and project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:52:06.073016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:52:06.080419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:52:06.401760 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8f93ab1c-3a9a-4ab6-8014-57562def91d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.890355 Jul 26 14:52:06.413169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 8/20] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:52:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:52:06.416157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f5752bf5-1db4-4e60-8501-2fe969be591d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:06.416877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f5752bf5-1db4-4e60-8501-2fe969be591d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:06.608339 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f5752bf5-1db4-4e60-8501-2fe969be591d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:06.616826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:06.617773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:06.630792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f5752bf5-1db4-4e60-8501-2fe969be591d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1236 microversion: 2.1 time: 0.219188 Jul 26 14:52:06.644019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 13/21] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:06 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1236 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:06.692709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:06.700363 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:06.702244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:06.707118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:06.798274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d245582e-9129-48c0-b3ea-bb6df1f1af9b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:06.799760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d245582e-9129-48c0-b3ea-bb6df1f1af9b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:06.925781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d245582e-9129-48c0-b3ea-bb6df1f1af9b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:06.936855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d245582e-9129-48c0-b3ea-bb6df1f1af9b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1242 microversion: 2.1 time: 0.143461 Jul 26 14:52:06.937076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 14/22] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:06 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1242 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:06.952253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d2705576-9690-4044-bfe7-c25f673e5621 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:06.952788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d2705576-9690-4044-bfe7-c25f673e5621 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:06.968790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:07.008947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6fa6dd9e-d438-4ab8-b3e3-f096707eba3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1218 microversion: 2.1 time: 0.396655 Jul 26 14:52:07.013624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 9/23] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:06 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1218 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:07.048326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d2705576-9690-4044-bfe7-c25f673e5621 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:07.056993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d2705576-9690-4044-bfe7-c25f673e5621 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1222 microversion: 2.1 time: 0.112485 Jul 26 14:52:07.058118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 15/24] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:06 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:07.574440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d3c8444f-854f-4921-9caf-2ae152203b8c tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e77e4430>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:07.657663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3ca4591b-611b-48a1-b4c9-8cfb48c241ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:07.658997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d3c8444f-854f-4921-9caf-2ae152203b8c tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/5713e337-12c6-4053-a0a0-0c1f75e7785b" status: 200 len: 351 microversion: 2.1 time: 0.097611 Jul 26 14:52:07.659977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3ca4591b-611b-48a1-b4c9-8cfb48c241ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:07.660089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 10/25] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:52:07 2022] GET /compute/v2.1/os-volumes/5713e337-12c6-4053-a0a0-0c1f75e7785b => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:07.784128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3ca4591b-611b-48a1-b4c9-8cfb48c241ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:07.797293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3ca4591b-611b-48a1-b4c9-8cfb48c241ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1236 microversion: 2.1 time: 0.145007 Jul 26 14:52:07.801429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 16/26] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:07 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:07.960936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:07.961690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:07.975378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:07.977587 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:07.980430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:07.981185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.030777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:08.031606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:08.044974 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.046344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.049670 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.053159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.072505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:08.082718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b8bc5313-497d-4211-96f5-b426b777bd2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1238 microversion: 2.1 time: 0.127977 Jul 26 14:52:08.084012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 11/27] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:07 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:08.099881 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:08.100817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:08.109409 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.113977 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.117226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.119604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.218123 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:08.228539 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4dc17f21-6084-4d47-b5bc-4568dcc9ce7e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1218 microversion: 2.1 time: 0.142488 Jul 26 14:52:08.229718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 12/28] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:08 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:08.354592 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:08.367819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8288d324-ef1d-4d0e-8b4d-2850c0c46cc4 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1266 microversion: 2.1 time: 0.341613 Jul 26 14:52:08.381918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 17/29] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:08 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1266 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:08.825124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:08.826431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:08.834524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.835117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.837558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:08.837558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:08.909430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:08.920249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-47f238cd-5f85-42f9-9992-78e16b1e9314 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1232 microversion: 2.1 time: 0.101002 Jul 26 14:52:08.920821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 13/30] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:08 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1232 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:09.122751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:09.123386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:09.129739 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.130261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.131212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.131680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.217667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:09.228161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b976d666-6cb8-4198-8ad6-e823a721a0a3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1294 microversion: 2.1 time: 0.118770 Jul 26 14:52:09.239708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 18/31] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:09 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:09.250353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:09.255393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:09.259793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.260376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.261448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.262446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.363578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:09.375318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-121c268d-e8c6-4201-ada9-51b533f7d8c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1274 microversion: 2.1 time: 0.128981 Jul 26 14:52:09.376042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 14/32] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:09 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:09.392637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:09.393813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:09.402240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.402763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.403592 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.404269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.495893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:09.518485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-558ffabc-f39f-41b8-86c4-0daa093e3200 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1274 microversion: 2.1 time: 0.132787 Jul 26 14:52:09.537985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 19/33] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:09 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1274 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:09.945615 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:09.946241 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:09.962878 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.963344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:09.964297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:09.965046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.156857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:10.165068 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c0b33969-9d1f-4044-b9b5-449a0dd26998 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1288 microversion: 2.1 time: 0.223926 Jul 26 14:52:10.166620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 15/34] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:09 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1288 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:10.250664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:10.251473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:10.255243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:10.259184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.259906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.260847 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.261615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.397345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:10.398564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:10.413893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.414493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.415294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.428244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.595486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:10.609467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f44a7ad5-0aee-462e-90e2-4d2a984ca15c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1302 microversion: 2.1 time: 0.360380 Jul 26 14:52:10.610118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 20/35] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:10 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1302 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:10.635711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:10.646353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:10.674852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.698531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.698531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:10.698531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:10.932846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:10.945932 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3081c85a-c4e5-4496-8e05-47c1930efcea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1282 microversion: 2.1 time: 0.553342 Jul 26 14:52:10.952090 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 16/36] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:10 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1282 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:10.974721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-deda0f96-b07c-4473-8c50-1901bad1c243 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6ebbaf0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:11.092048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-deda0f96-b07c-4473-8c50-1901bad1c243 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/d155f03c-7c9b-4571-997d-3737d4111f19" status: 200 len: 350 microversion: 2.1 time: 0.121660 Jul 26 14:52:11.092887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 17/37] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:52:10 2022] GET /compute/v2.1/os-volumes/d155f03c-7c9b-4571-997d-3737d4111f19 => generated 350 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:52:11.104227 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:11.132148 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-090ada95-cb5f-42e9-95df-311797969633 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1272 microversion: 2.1 time: 0.518991 Jul 26 14:52:11.139554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 21/38] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:10 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1272 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:11.189231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:11.190207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:11.203088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:11.207702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:11.209145 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:11.214538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:11.370918 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:11.388312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-32ff0dec-4332-4756-902d-ebedcd75622a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1296 microversion: 2.1 time: 0.202491 Jul 26 14:52:11.398553 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 18/39] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:11 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1296 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:11.643656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:11.644837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:11.652991 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:11.653921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:11.655163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:11.655952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:11.777349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:11.788051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0cd688cb-3fec-4cc2-b310-bbdbcd0d56ed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1300 microversion: 2.1 time: 0.148154 Jul 26 14:52:11.798425 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 22/40] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:11 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:11.986909 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:11.987572 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:12.006221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.006668 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.007493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.007945 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.154191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:12.154908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:12.166262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.166899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.170921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.171572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.690974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:12.701264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-37484890-a7c0-40a8-afe5-71a5dc963fe9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1280 microversion: 2.1 time: 0.733380 Jul 26 14:52:12.703377 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 19/41] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:11 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1280 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:12.715488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:12.716351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:12.737055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.737055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.737055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.737055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.885216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:12.899206 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e545c03c-8d93-4907-843f-0a2725bcaac8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1294 microversion: 2.1 time: 0.186923 Jul 26 14:52:12.900240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 20/42] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:12 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:12.905220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:12.915999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:12.928848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.932125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:12.933174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:12.935378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:13.034853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:13.049735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bfc92455-85b4-448f-8d77-b26c4dbc5231 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.896284 Jul 26 14:52:13.050458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 23/43] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:12 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:13.241746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:13.259353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cef77e91-0d76-477c-9b7d-6a86b521ed46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1300 microversion: 2.1 time: 0.355425 Jul 26 14:52:13.274142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 21/44] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:12 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:13.726617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:13.742365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:13.742365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:13.742365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:13.742365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:13.742767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:13.929535 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:13.930838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:13.954126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:13.954126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:13.954126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:13.954126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:14.524094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:14.540981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1994502c-1736-4635-911c-dfddf54147e3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.818145 Jul 26 14:52:14.562237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 24/45] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:13 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:14.568577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f9b1f790-2c32-4a73-8662-1eb30e7a9f14 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e7807790>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:14.689349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f9b1f790-2c32-4a73-8662-1eb30e7a9f14 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/800d9d3e-5712-4f52-8530-79e5e02cb11a" status: 200 len: 351 microversion: 2.1 time: 0.125596 Jul 26 14:52:14.689937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 25/46] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 14:52:14 2022] GET /compute/v2.1/os-volumes/800d9d3e-5712-4f52-8530-79e5e02cb11a => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:14.705487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:14.712742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:14.721895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:14.722362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:14.723172 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:14.730873 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:14.989131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:15.119622 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:15.145400 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-58e1ca6c-007a-4883-a8f7-1417d3d93f55 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 1.219684 Jul 26 14:52:15.149150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 22/47] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:13 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:15.158749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:15.160064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:15.180575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.183024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:15.184666 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.185439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:15.372653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:15.405336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-be4d37fc-fcaa-4f8d-b20e-2e48fb07faed tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.692955 Jul 26 14:52:15.412363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 26/48] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:14 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:15.450658 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d4bcf429-e79e-4997-a5f8-ab10ae392b8d tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6748700>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:15.855749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d4bcf429-e79e-4997-a5f8-ab10ae392b8d tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.437721 Jul 26 14:52:15.857279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 27/49] 10.222.0.97 () {58 vars in 1134 bytes} [Tue Jul 26 14:52:15 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:15.871923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:15.872712 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:15.901527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.904380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:15.906923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:15.908347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:16.002434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:16.059476 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=18 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:16.333336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:16.348210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6f219d8b-2eb4-4c94-b619-b74fb26a857a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 1.193000 Jul 26 14:52:16.348210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 23/50] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:15 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:16.460200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-77c0e92c-ee86-4b24-b861-e462713db2e3 req-73381fda-0a6e-4020-afdc-d13a0af10244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef4043a-5d67-4091-abcb-ed5e596ba355", "tag": "a5d6c726-a2d1-4d56-97ab-81d623c53ac3"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:16.486331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-77c0e92c-ee86-4b24-b861-e462713db2e3 req-73381fda-0a6e-4020-afdc-d13a0af10244 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:16.487717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-77c0e92c-ee86-4b24-b861-e462713db2e3 req-73381fda-0a6e-4020-afdc-d13a0af10244 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:16.547243 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-77c0e92c-ee86-4b24-b861-e462713db2e3 req-73381fda-0a6e-4020-afdc-d13a0af10244 service nova] Creating event network-changed:a5d6c726-a2d1-4d56-97ab-81d623c53ac3 for instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 on hv-cinder-85103 Jul 26 14:52:16.548248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-77c0e92c-ee86-4b24-b861-e462713db2e3 req-73381fda-0a6e-4020-afdc-d13a0af10244 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:52:16.549817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:16.550904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:16.552086 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:16.553274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:16.568322 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.compute.rpcapi [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 14:52:16.574189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] Releasing lock "compute-rpcapi-router" {{(pid=124888) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:52:16.603833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f4ac61b4-0631-4e53-9cca-6f138dfa121a None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.253113 Jul 26 14:52:16.604608 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 24/51] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:16.621357 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e792a57a-3db9-4520-8908-19c3099a433b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6ebba60>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:16.656661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:16.679296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8e0aea10-a5bd-452e-9499-2de590c91e71 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.818387 Jul 26 14:52:16.685797 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 28/52] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:15 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:16.708226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:16.711734 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:16.742463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:16.742936 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:16.761385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:16.761862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.086903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e792a57a-3db9-4520-8908-19c3099a433b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.480215 Jul 26 14:52:17.087630 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 25/53] 10.222.0.97 () {58 vars in 1149 bytes} [Tue Jul 26 14:52:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:17.098444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:17.098444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:17.119914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.127674 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.129875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.133066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.608842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:17.635863 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f0a70913-653c-4be6-9c15-90bad9c25af1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.948480 Jul 26 14:52:17.648209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 29/54] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:16 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:17.657377 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-319b03e9-2872-4eb7-814c-c35ea10b2d5b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e66f28b0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:17.797393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=38 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:17.925661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:17.936490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-578a641c-93de-4f08-830e-ba9f295cb131 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.847545 Jul 26 14:52:17.938346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 26/55] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:17 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:17.950759 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:17.953781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:17.969065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.969065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:17.969065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:17.969065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:18.017837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-319b03e9-2872-4eb7-814c-c35ea10b2d5b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.367564 Jul 26 14:52:18.018715 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 30/56] 10.222.0.97 () {58 vars in 1134 bytes} [Tue Jul 26 14:52:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:18.024589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:18.027503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:18.043512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:18.044416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:18.045517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:18.053952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:18.613311 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:18.621812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-387ef60e-1203-45d6-8073-312afabe1444 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.601989 Jul 26 14:52:18.627841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 31/57] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:18 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:18.665572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2027377b-a39a-433a-ab89-fa0e49794703 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e66f2820>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:18.937346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2027377b-a39a-433a-ab89-fa0e49794703 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.296435 Jul 26 14:52:18.949025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 32/58] 10.222.0.97 () {58 vars in 1167 bytes} [Tue Jul 26 14:52:18 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:19.096858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-4f82fdeb-8d9f-4576-8ec7-384938bc560b req-e1be2319-c4e5-46cc-b171-aa0aea5c42cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a97d630c-f890-4022-87ba-406020a397dc", "tag": "098d52c8-2012-4286-962d-62149a4873c1"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:19.130198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4f82fdeb-8d9f-4576-8ec7-384938bc560b req-e1be2319-c4e5-46cc-b171-aa0aea5c42cb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.130198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4f82fdeb-8d9f-4576-8ec7-384938bc560b req-e1be2319-c4e5-46cc-b171-aa0aea5c42cb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.156573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-4f82fdeb-8d9f-4576-8ec7-384938bc560b req-e1be2319-c4e5-46cc-b171-aa0aea5c42cb service nova] Creating event network-changed:098d52c8-2012-4286-962d-62149a4873c1 for instance a97d630c-f890-4022-87ba-406020a397dc on hv-cinder-85103 Jul 26 14:52:19.157691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4f82fdeb-8d9f-4576-8ec7-384938bc560b req-e1be2319-c4e5-46cc-b171-aa0aea5c42cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 14:52:19.159358 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.160126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.161365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.165557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.176474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.compute.rpcapi [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 14:52:19.177433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] Releasing lock "compute-rpcapi-router" {{(pid=124889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 14:52:19.229595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3c2da313-b65e-4637-8efd-d4bd8348377e None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281764 Jul 26 14:52:19.239146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 33/59] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:19.239146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:19.239146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:19.244618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.245414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.246520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.247208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.299779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:19.306554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:19.315556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-32064713-9332-451a-ba5a-4b6a50d3c2e6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 1.375799 Jul 26 14:52:19.318864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 27/60] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:17 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:19.327336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-ab4a6848-bb9b-4e23-8087-05fc0daacdd6 req-25215c99-eac2-4332-8df9-c548e2edb9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c808f60-6b5e-4ad9-8463-47c749c4ad58", "tag": "73723af2-05ec-4b78-b99d-0201637337f6"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:19.342915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-ab4a6848-bb9b-4e23-8087-05fc0daacdd6 req-25215c99-eac2-4332-8df9-c548e2edb9e1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.343387 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-ab4a6848-bb9b-4e23-8087-05fc0daacdd6 req-25215c99-eac2-4332-8df9-c548e2edb9e1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.357472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-ab4a6848-bb9b-4e23-8087-05fc0daacdd6 req-25215c99-eac2-4332-8df9-c548e2edb9e1 service nova] Creating event network-changed:73723af2-05ec-4b78-b99d-0201637337f6 for instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 on hv-cinder-85103 Jul 26 14:52:19.363243 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-ab4a6848-bb9b-4e23-8087-05fc0daacdd6 req-25215c99-eac2-4332-8df9-c548e2edb9e1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045381 Jul 26 14:52:19.365775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 28/61] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:19.371728 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-60b597d5-4299-4657-9408-98f205277705 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6f10f70>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:19.497598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-60b597d5-4299-4657-9408-98f205277705 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.129892 Jul 26 14:52:19.498367 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 29/62] 10.222.0.97 () {58 vars in 1170 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:19.503943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:19.504845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:19.515525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.516950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.517804 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.518481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.593579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:19.604214 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-85352133-d81f-47ae-970d-1d26d0aba6e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.372455 Jul 26 14:52:19.604867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 34/63] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:19.616317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-57962788-24fd-4c53-af82-9b7b8b151039 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6703820>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:19.753831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-57962788-24fd-4c53-af82-9b7b8b151039 tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.141729 Jul 26 14:52:19.754579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 35/64] 10.222.0.97 () {58 vars in 1155 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:19.763257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:19.764150 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:19.780311 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.781096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.782193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:19.782835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:19.922312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:19.946410 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4de4802b-7c6c-4746-969e-bbe7ff4635d0 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.446436 Jul 26 14:52:19.951551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 30/65] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:19.968776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f1945c27-ebf6-4860-9614-74206eb8ec7b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6e8e0d0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:20.195923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:20.205077 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f1945c27-ebf6-4860-9614-74206eb8ec7b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.249774 Jul 26 14:52:20.205655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 31/66] 10.222.0.97 () {58 vars in 1188 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:20.205796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-97ae7877-4955-4218-880e-434d6354d64a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.450004 Jul 26 14:52:20.219534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 36/67] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:19 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:20.220849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fe7e21d7-8d61-4d71-82f5-fac14853bf7b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] Calling method '.version_select at 0x7f97e6f10940>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:20.328253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fe7e21d7-8d61-4d71-82f5-fac14853bf7b tempest-VolumesTestJSON-1822401250 tempest-VolumesTestJSON-1822401250-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111824 Jul 26 14:52:20.332175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 32/68] 10.222.0.97 () {58 vars in 1155 bytes} [Tue Jul 26 14:52:20 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:20.344764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:20.346532 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:20.357760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.360269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.360269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.360269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.567883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:20.578073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7677351b-43f3-488c-ba27-79a86fa2e66a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.243400 Jul 26 14:52:20.579209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 37/69] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:20 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:20.631117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:20.631765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:20.640055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.645533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.645533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.645533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.825669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:20.841829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0e7d9c2e-89ac-4c06-a4e8-d133e7adf357 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.214410 Jul 26 14:52:20.852150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 33/70] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:20 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:20.973266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:20.973894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:20.981047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.981370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.983635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:20.984253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:20.989976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:21.221311 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:21.229334 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:21.229726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8e76240f-d224-4963-9990-d1474a8b4c1e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.260547 Jul 26 14:52:21.229963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:21.230084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 38/71] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:20 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:21.256502 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19044933-e557-4fb7-87ca-e67b212eb6bf", "tag": "ad48d699-f27b-41ef-82f4-21fe1b9332b8"}, {"name": "network-changed", "server_uuid": "d1552ebb-d614-4398-96ba-47e3fd737e3d", "tag": "f52ee38e-091f-4eb3-93dc-683dcd709ebd"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:21.268661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.269120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.269919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.270366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.279997 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.280680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.310764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] Creating event network-changed:ad48d699-f27b-41ef-82f4-21fe1b9332b8 for instance 19044933-e557-4fb7-87ca-e67b212eb6bf on hv-cinder-85103 Jul 26 14:52:21.311884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] Creating event network-changed:f52ee38e-091f-4eb3-93dc-683dcd709ebd for instance d1552ebb-d614-4398-96ba-47e3fd737e3d on hv-cinder-85103 Jul 26 14:52:21.329835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-cce33663-7243-4a4f-b566-7c7a796879a5 req-ea0078e6-99b8-46e2-bf8c-1aba7df9ea41 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077163 Jul 26 14:52:21.331596 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 39/72] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:52:21.473256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:21.483270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d5523868-8b2d-4b7f-be2d-bfbe8d1dbd4c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.258835 Jul 26 14:52:21.486582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 34/73] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:21 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:21.607023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:21.608027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:21.615095 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.615709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.616673 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.617136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.856015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:21.864344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ed8a09f2-62ac-42a4-9356-1fd20458173e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.260879 Jul 26 14:52:21.864344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 40/74] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:21 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:21.878484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:21.879177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:21.885908 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.886441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:21.887825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:21.888302 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.177235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:22.190498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-490252ce-0f93-4125-9bd3-cc6972b5fcb8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.316308 Jul 26 14:52:22.201622 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 35/75] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:21 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:22.251120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:22.252434 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:22.267900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.268446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.269314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.269858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.466861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:22.475882 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e8554e05-9479-4c85-be1e-0acafb34be62 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.228791 Jul 26 14:52:22.476852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 41/76] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:22 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:22.507347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:22.508007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:22.515210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.515922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.517207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.517835 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.702027 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:22.716115 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c5a7bac1-16e8-4a9e-a80c-b25495cb4988 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.213165 Jul 26 14:52:22.717996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 36/77] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:22 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:22.889952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:22.890822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:22.905162 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.906435 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:22.908217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:22.909001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.184929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:23.192861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0bc4f5e0-9478-4f83-9c6a-9f17c855ef0e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.306910 Jul 26 14:52:23.193616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 42/78] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:22 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:23.214582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:23.215337 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:23.221998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.222525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.223450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.224014 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.497252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:23.498613 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:23.529283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.538635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.538635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.538635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.557554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:23.576550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b9a2ac10-5db9-4aa3-993b-e75eeafec5e0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.366534 Jul 26 14:52:23.597384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 37/79] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:23 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:23.695929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:23.705008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8bb1852d-969f-4338-90a5-5065153c74d5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.210711 Jul 26 14:52:23.705008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 43/80] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:23 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:23.742562 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:23.744983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:23.748837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:23.750952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.751596 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.752830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:23.753577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:23.910822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:23.924650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8fa9f024-2fb7-4efe-922b-18816458853b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.187303 Jul 26 14:52:23.925393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 38/81] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:23 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:24.214711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:24.215359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:24.221737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.222234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.223107 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.223578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.368347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:24.377164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ab4ca5b3-fc7d-4b0c-914e-22610f73443b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.166271 Jul 26 14:52:24.377950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 44/82] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:24 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:24.602951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:24.603873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:24.610702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.610702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.611675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.612138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.732893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:24.732893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:24.735769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.736329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.737432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.737944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.753733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:24.762177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6c83c57e-3618-4cf8-8441-0cd3f622e030 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.163959 Jul 26 14:52:24.764788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 39/83] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:24 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:24.884168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:24.891889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0faee8fb-4328-443a-92bd-6600e652570c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.169632 Jul 26 14:52:24.892685 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 45/84] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:24 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:24.946542 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:24.948411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:24.954608 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.955314 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:24.956626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:24.957315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.142438 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:25.150524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-25ee342c-00b9-4223-8c01-ed1daba69f58 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.208335 Jul 26 14:52:25.151667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 40/85] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:24 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:25.404623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:25.404623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:25.420134 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.420808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.422270 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.423117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.594736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:25.603993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ed5a4532-e75f-4ce0-8e95-38404392b0fc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.208422 Jul 26 14:52:25.604578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 46/86] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:25 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:25.784113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:25.784732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:25.791496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.792186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.793177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.793852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.916595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:25.916595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:25.920254 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.921154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.922159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:25.922817 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:25.962436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:25.977438 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9932eaa3-c538-491d-848e-c767bd21e84d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.197485 Jul 26 14:52:25.979436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 41/87] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:25 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:26.154077 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:26.162135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-813f0584-faaa-4fea-bcee-4dc5f953117e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.253770 Jul 26 14:52:26.162751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 47/88] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:25 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:26.181036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:26.181642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:26.187805 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.188256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:26.189973 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.190761 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:26.477636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:26.496268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-926821c1-a4c2-41e3-8f7f-65565d8a25a1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.321205 Jul 26 14:52:26.496973 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 42/89] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:26 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:26.626140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:26.627086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:26.634025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.634906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:26.635866 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:26.636551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:26.816158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:26.827868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7e7e4145-108d-4a5c-a041-75fae1044848 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.203827 Jul 26 14:52:26.827868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 48/90] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:26 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:27.007442 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:27.008154 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:27.014564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.016905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.016905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.016905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.146182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:27.154269 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5b074464-7a34-488d-a8f0-808fac182d24 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.151716 Jul 26 14:52:27.154837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 43/91] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:27 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:27.183861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:27.184730 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:27.190845 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.191310 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.195792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.195792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.337168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:27.344870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-68c5ebf8-686b-47c5-9e87-bf1e87a14d13 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.165504 Jul 26 14:52:27.345448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 49/92] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:27 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:27.517569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:27.522911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:27.522911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:27.525283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.525738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.526515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.526954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.672909 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:27.680561 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-851a9c42-a4a2-4374-bfad-c7be8d8baa68 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.166852 Jul 26 14:52:27.686653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 44/93] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:27 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:27.847228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:27.847896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:27.854450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.854912 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.855742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:27.856161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:27.990963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:27.998499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fb128fa9-6c54-43b0-aac7-ecda142cb85d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.155095 Jul 26 14:52:27.999072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 50/94] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:27 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:28.176141 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.176756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.183973 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.184419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.185195 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.185808 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.317979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:28.325733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-94f73b60-421a-43f1-8ef9-16660d765aa0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.153847 Jul 26 14:52:28.326405 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 45/95] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:28 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:28.366725 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.367377 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.373697 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.374206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.377644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.377644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.514625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:28.524537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-89659047-d31a-4766-85a6-54c3d8cbc44f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.162180 Jul 26 14:52:28.525463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 51/96] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:28 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:28.709408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:28.710848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:28.722734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.723564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.724627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:28.725392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:28.887387 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:28.896035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0a5fe667-19b2-427e-b35a-f93233f541e6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.193342 Jul 26 14:52:28.897304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 46/97] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:28 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:29.021690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.022322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.030296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.030296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.030507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.031097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.174484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:29.202343 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:29.211215 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-767d374b-d742-4afd-8420-656ef753c09a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.194006 Jul 26 14:52:29.225369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 52/98] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:29.346328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.346941 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.353116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.353565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.354336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.354772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.485404 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:29.493143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-16e10ffb-8de1-4f63-92ec-2f206ce12b7f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.150730 Jul 26 14:52:29.493862 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 47/99] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:29.548748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.550584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.557541 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.557988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.558758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.559192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.699616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:29.709357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0a75639d-6c47-4518-96ab-8b03888d687e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.165624 Jul 26 14:52:29.711646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 53/100] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:29.918590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:29.919394 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:29.926032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.926681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.927563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:29.928158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:29.932591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:30.065111 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:30.072602 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9191b23d-056b-4ec9-9269-4f136ebb63b2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.158318 Jul 26 14:52:30.073174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 48/101] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:29 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:30.236385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:30.237152 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:30.245945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.246407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.247192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.247669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.389362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:30.396964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a7c18226-ebef-481b-8444-03896f86ed25 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.167501 Jul 26 14:52:30.397556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 54/102] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:30 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:30.514144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:30.515525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:30.522135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.522595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.524694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.524694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.660616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:30.668050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-75b73238-9fff-4475-844b-08295d039a2d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.157853 Jul 26 14:52:30.668617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 49/103] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:30 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:30.732067 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:30.732675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:30.739671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.739671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.739943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:30.740376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:30.759709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:30.873315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:30.880998 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d46569f5-20b7-48d2-95a0-0945778611a2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.152807 Jul 26 14:52:30.881561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 55/104] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:30 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:31.095342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.096606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.122063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.123448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.124957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.125968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.284218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:31.302926 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-345e9b26-d35d-49bc-b34f-0c01918de032 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.212998 Jul 26 14:52:31.318818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 50/105] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:31.417634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.418241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.425664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.427470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.428409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.429368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.566323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:31.574371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-43edad76-0940-495f-b703-3842e11a5293 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.160526 Jul 26 14:52:31.574938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 56/106] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:31.689533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.690144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.696230 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.696677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.697469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.697913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.829164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:31.837713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-83835299-3180-4c03-8a1a-4d5c79946bd5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.152089 Jul 26 14:52:31.838713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 51/107] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:31.902235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:31.903005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:31.909026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.909473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:31.910235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:31.910668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.083577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:32.083577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-87b5f381-38af-46eb-b285-d0912ed2d8ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.162325 Jul 26 14:52:32.083577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 57/108] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:31 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:32.326788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:32.327432 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:32.333660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.334104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.334871 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.335317 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.595644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:32.596287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:32.603476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.603939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.604726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.605170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.658457 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:32.666420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a6f7c0aa-e90e-4b14-884c-3e09aedff28e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.343489 Jul 26 14:52:32.666995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 52/109] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:32 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:32.756795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:32.765126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-69fa20f2-9ec8-4aac-a490-f6c494981b34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.174402 Jul 26 14:52:32.765794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 58/110] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:32 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:32.859011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:32.866309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:32.866309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.866309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:32.867443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:32.867886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.001837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:33.009237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6f3b590f-85a5-4796-9576-89570a00e3e5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.154127 Jul 26 14:52:33.009792 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 53/111] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:32 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:33.092726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:33.093332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:33.099674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.100185 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.101509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.102005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.240132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:33.249092 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e069ec0b-d0c9-41a2-b014-f5fbdb3a153c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.160149 Jul 26 14:52:33.249841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 59/112] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:33 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:33.690399 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:33.691103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:33.697751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.698292 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.699169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.700003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.786255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:33.786880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:33.793961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.794416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.795259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:33.795768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:33.843262 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:33.865787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e325b8eb-4372-4fe8-a00d-539520d94fcb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.165650 Jul 26 14:52:33.865787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 54/113] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:33 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:33.937097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:33.945400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-70449328-066a-46dd-bb09-a27c6120c5b3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.162529 Jul 26 14:52:33.946043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 60/114] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:33 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:34.029704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.030238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.036228 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.036681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.043213 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.043213 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.182462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:34.192275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b38bfb03-f341-497b-9038-4e3611fd704c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.166418 Jul 26 14:52:34.192929 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 55/115] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:34.273857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.274472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.281067 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.281454 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.282358 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.283371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.416599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:34.424156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2f71595e-0f86-4a8c-bfb1-c614d72be68c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.154906 Jul 26 14:52:34.424729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 61/116] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:34.872992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.873524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.879818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.880273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.881043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.881483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.971283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:34.971283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:34.972453 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.972914 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:34.973720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:34.974131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.024854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.032266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5a7f345c-38a4-4a19-a532-8e0b3237db1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.163243 Jul 26 14:52:35.033056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 56/117] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:35.109492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.117700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8f597d77-5af2-4907-ab25-f2c9547e4cc8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.155160 Jul 26 14:52:35.118261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 62/118] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:34 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:35.215365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.216131 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.222219 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.222663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.223449 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.223885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.349579 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.357860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-91d1ab6d-14ef-4f93-8be4-f092f9399159 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.147571 Jul 26 14:52:35.358434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 57/119] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:35 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:35.448004 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:35.448558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:35.454487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.454944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.455751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:35.456191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:35.589446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:35.596888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6e4ba498-e347-4f1f-92d4-c7b6c0bfc7cd tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.152874 Jul 26 14:52:35.597489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 63/120] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:35 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:36.053583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.054826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.061243 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.061703 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.062481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.062921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.138659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.139459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.145540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.145994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.146770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.147211 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.190682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:36.198480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6872446f-e819-496b-bc21-d9908523a686 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.149051 Jul 26 14:52:36.199074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 58/121] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:36.285045 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:36.292549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-032b3409-d1eb-40d7-a329-eaa7d5c4ad42 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.157741 Jul 26 14:52:36.293118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 64/122] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:36.378727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.379335 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.385864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.386314 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.387073 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.387616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.516575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:36.524446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-04995f6d-41eb-4ca0-bfac-deef8cf709ba tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.149919 Jul 26 14:52:36.525025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 59/123] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:36.619612 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:36.620231 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:36.626534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.626985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.627778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:36.628213 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:36.753409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:36.761052 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-220ebc1b-9562-435c-86f8-a33be29c42a1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.145978 Jul 26 14:52:36.761621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 65/124] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:36 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:37.220430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:37.221765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:37.228640 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.229414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.230220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.230660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.312961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:37.313810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:37.320853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.321311 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.322095 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.322600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.382365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.390285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4c8c9615-b55f-4cc1-bc3c-f4e920929df2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.173776 Jul 26 14:52:37.390955 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 60/125] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:37 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:37.455570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.463570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9bc326dd-f820-457a-86c6-b38b31e5de1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.154949 Jul 26 14:52:37.464137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 66/126] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:37 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:37.546582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:37.547315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:37.553988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.554511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.555289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.555748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.782375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:37.783177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:37.790101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.790557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.791337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:37.791966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:37.913105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.924133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ef132179-b4ee-405c-b2c7-89b67eb4cb53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.381922 Jul 26 14:52:37.925474 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 61/127] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:37 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:37.943537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:37.951151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-03da94b4-867c-4762-a7e0-431b219d50e3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.172744 Jul 26 14:52:37.952020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 67/128] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:37 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:38.411559 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.412369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.419333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.419812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.420582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.421018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.484945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.485732 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.492233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.492749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.493625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.494066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.558331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:38.565953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-228f6ab1-cec2-431a-85a6-ff4f573fb41a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.158390 Jul 26 14:52:38.566518 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 62/129] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:38.628428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:38.635983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f1aabbe6-df34-4909-af26-c98407d88fbe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.155481 Jul 26 14:52:38.636681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 68/130] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:38.949277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.949884 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.956415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.956946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.958034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.958490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.973961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:38.974911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:38.983620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.985823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:38.987035 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:38.987653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.120612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:39.128633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c08c6101-6925-403d-867f-4dd09498f75f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.183826 Jul 26 14:52:39.129385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 63/131] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:39.150521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:39.158204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e3d54039-f308-4bec-95b7-5a16b2fc0042 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.188045 Jul 26 14:52:39.158772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 69/132] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:38 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:39.586422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:39.587143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:39.593615 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.594069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.595015 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.595488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.660528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:39.661761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:39.670659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.671427 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.672971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:39.673570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:39.797502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:39.801664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:39.806018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-14091fa6-0c8b-4de1-8e72-39ba7e62481f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.223619 Jul 26 14:52:39.806886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 64/133] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:39 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:39.829020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:39.837145 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-828c0fc7-69d4-46e0-af09-fc19e5199361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.183106 Jul 26 14:52:39.837855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 70/134] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:39 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:40.150913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:40.151460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:40.157576 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.158021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.158780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.159212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.178008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:40.178720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:40.185524 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.185981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.186767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.187217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.344920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:40.358244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:40.364969 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c16750cc-eb29-4c01-bf41-5dfab7e821e3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.217793 Jul 26 14:52:40.365671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 65/135] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:40 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:40.383780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bc2393d8-3b7f-4f40-8e13-3c635abce10b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.207651 Jul 26 14:52:40.383780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 71/136] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:40 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:40.828342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:40.828961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:40.835316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.835792 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.836619 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.837064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.858677 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:40.859636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:40.865800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.871192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.871192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:40.871192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:40.872389 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:40.988413 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:41.001256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d323ede8-e479-4307-8406-107d7e412bc3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.176387 Jul 26 14:52:41.003469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 66/137] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:40 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:41.005835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:41.015771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-29ad3e74-e441-4afb-b8ef-f942f0b54b04 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.161020 Jul 26 14:52:41.017588 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 72/138] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:40 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:41.389975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:41.390587 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:41.399263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.399763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:41.400616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.401059 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:41.411321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:41.412180 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:41.421728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.422682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:41.423599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:41.424190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:41.556530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:41.564256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fff40420-528d-4299-93b9-c7b7438b9506 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.178153 Jul 26 14:52:41.564839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 67/139] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:41 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:41.566268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:41.574689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-04350258-77e2-41e6-bfa4-5c3e58705fa2 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.173790 Jul 26 14:52:41.575627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 73/140] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:41 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:42.026852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:42.027546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:42.033640 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.034091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.034866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.035304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.040051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:42.040756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:42.047591 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.048051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.048851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.049310 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.177956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:42.187056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5487b097-e60e-4e6b-a1e3-277f91bd2577 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.163960 Jul 26 14:52:42.188238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 68/141] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:42 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:42.190001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:42.203143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-49d64139-2b19-44bf-bae4-93109a20f396 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.166986 Jul 26 14:52:42.203772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 74/142] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:42 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:42.584702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:42.585305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:42.591479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.591923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.592754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.593187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.599153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:42.600323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:42.603748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:42.607132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.607643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.608422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:42.608863 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:42.728129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:42.736074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a0ffe95e-08ba-4efe-a9bc-02f188857651 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.155068 Jul 26 14:52:42.736502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 69/143] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:42 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:42.755908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:42.764186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4e2f24d7-fd2e-48e8-a15d-a0695273bb97 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.168839 Jul 26 14:52:42.765041 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 75/144] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:42 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:43.208142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.208865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.215892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.216209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.217049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.217491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.227382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.228218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.235575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.236310 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.237073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.237514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.400807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:43.404787 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:43.409898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c14e2796-e7df-455a-b3a1-d7320e0e8b37 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.206403 Jul 26 14:52:43.411021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 70/145] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:43.412494 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b461fbd2-9aec-48ae-a25d-561d9001f6c6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.190523 Jul 26 14:52:43.413369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 76/146] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:43.620496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-ec311250-270c-4884-8039-79c9c4b41fb2 req-d023682e-e4ff-4961-be35-6b7512ae1f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19044933-e557-4fb7-87ca-e67b212eb6bf", "name": "network-vif-plugged", "status": "completed", "tag": "ad48d699-f27b-41ef-82f4-21fe1b9332b8"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:43.633205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-ec311250-270c-4884-8039-79c9c4b41fb2 req-d023682e-e4ff-4961-be35-6b7512ae1f6a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.633903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-ec311250-270c-4884-8039-79c9c4b41fb2 req-d023682e-e4ff-4961-be35-6b7512ae1f6a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.645782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-ec311250-270c-4884-8039-79c9c4b41fb2 req-d023682e-e4ff-4961-be35-6b7512ae1f6a service nova] Creating event network-vif-plugged:ad48d699-f27b-41ef-82f4-21fe1b9332b8 for instance 19044933-e557-4fb7-87ca-e67b212eb6bf on hv-cinder-85103 Jul 26 14:52:43.659968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-ec311250-270c-4884-8039-79c9c4b41fb2 req-d023682e-e4ff-4961-be35-6b7512ae1f6a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178342 Jul 26 14:52:43.659968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 71/147] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:43.758723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.759340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.781072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.781548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.782375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.782825 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.801933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:43.803050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:43.812363 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.813021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.814480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:43.815188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:43.953349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:43.961748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-42c1cc0e-8292-4122-877a-4dd85f580695 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.207086 Jul 26 14:52:43.963022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 77/148] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:44.013748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:44.025326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ba30d688-4256-40d5-80d8-2a0822e43a1d tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.237920 Jul 26 14:52:44.025947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 72/149] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:43 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:44.435130 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:44.436065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:44.437511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:44.439269 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:44.443621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.444065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:44.445760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.447097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:44.448414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.449228 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:44.450240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.451319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:44.604792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:44.611491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:44.613371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ba8286ef-7c1e-4545-8774-c1593878964d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.183912 Jul 26 14:52:44.620270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c4cd25b3-b989-4710-a6d8-edd107a29d46 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.190669 Jul 26 14:52:44.620961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 73/150] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:44 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:44.626731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 78/151] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:44 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:44.985089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:44.989089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:44.994149 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.994826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:44.995872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:44.996506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.059387 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:45.062319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:45.075872 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.076640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.077884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.078886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.161581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:45.174915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b501abc0-3db0-41f7-8b4c-053529350d07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.194653 Jul 26 14:52:45.175753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 74/152] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:44 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:45.252884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:45.262311 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fc3c1aa2-d202-4572-9fca-d8222c70da75 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.213928 Jul 26 14:52:45.263663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 79/153] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:45 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:45.634929 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:45.636114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:45.647339 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:45.647980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:45.653377 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.654028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.654823 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.655272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.655525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.656278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.657392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.657941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.814986 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:45.825818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e92cbd3f-72ad-40c5-9353-4e5e5102be6c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.182174 Jul 26 14:52:45.826931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 80/154] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:45 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:45.832001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-897a1734-28e3-44f5-ac6f-d347c5c88b81 req-f63b7b57-ca16-4155-bb8f-6de025aadb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97d630c-f890-4022-87ba-406020a397dc", "name": "network-vif-plugged", "status": "completed", "tag": "098d52c8-2012-4286-962d-62149a4873c1"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:45.843330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-897a1734-28e3-44f5-ac6f-d347c5c88b81 req-f63b7b57-ca16-4155-bb8f-6de025aadb9b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:45.843897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-897a1734-28e3-44f5-ac6f-d347c5c88b81 req-f63b7b57-ca16-4155-bb8f-6de025aadb9b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:45.856786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-897a1734-28e3-44f5-ac6f-d347c5c88b81 req-f63b7b57-ca16-4155-bb8f-6de025aadb9b service nova] Creating event network-vif-plugged:098d52c8-2012-4286-962d-62149a4873c1 for instance a97d630c-f890-4022-87ba-406020a397dc on hv-cinder-85103 Jul 26 14:52:45.861900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-897a1734-28e3-44f5-ac6f-d347c5c88b81 req-f63b7b57-ca16-4155-bb8f-6de025aadb9b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 Jul 26 14:52:45.862681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 81/155] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:45.922846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:45.935308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bbaa4174-db6b-4f49-aed4-41605c4203d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.304553 Jul 26 14:52:45.936844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 75/156] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:45 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:46.198023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.198761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.205234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.205691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.206472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.206921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.285767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.286939 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.295037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.296484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.297358 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.297853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.348137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:46.356509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2268a613-20bd-4ac0-aeba-5bb6728529ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.163799 Jul 26 14:52:46.361723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 82/157] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:46.485588 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:46.498239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-85229e9b-6ef1-4a65-8800-9386f872280e tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.216875 Jul 26 14:52:46.504610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 76/158] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:46.847825 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.848439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.854966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.855451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.856220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.856661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.957822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:46.958466 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:46.964410 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.964860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.965623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:46.966059 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:46.985629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:46.995465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a882dc5c-bcc1-4fbe-ba1d-f262be5c2bae tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.151453 Jul 26 14:52:46.996289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 83/159] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:47.110963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:47.120585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6cc2be93-f727-4473-86ba-55bd80756543 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.165420 Jul 26 14:52:47.121193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 77/160] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:46 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:47.376835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:47.377368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:47.383833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.384322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:47.392700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.392700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:47.525896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:47.535849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:47.535849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.535849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:47.535849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:47.536187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:47.676190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:47.707107 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f050b5e6-9b9b-4ba5-8334-69f75c3ec91d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.330354 Jul 26 14:52:47.708907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 84/161] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:47 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:47.777906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:47.782270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-66c93e39-45b1-4dcc-af43-21a3dbb25abc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.261682 Jul 26 14:52:47.790221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 78/162] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:47 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:48.018187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:48.019115 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:48.036536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.037241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.039032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.044304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.141924 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:48.143257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:48.151961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.153311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.160842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.160842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.575988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:48.586804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6ce89226-3a71-4cf5-b30f-9592d5ce6728 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.573852 Jul 26 14:52:48.588173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 85/163] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:48 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:48.737771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:48.738589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:48.753822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.754290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.755088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.755556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.882696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:48.896472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a0cdcd56-a6a2-404d-bdbe-5bac65822339 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.753772 Jul 26 14:52:48.897757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 79/164] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:48 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:48.916105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:48.916727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:48.928064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.928721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:48.929790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:48.931002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.021718 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:49.032865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4e932b3d-3f6a-403e-b5d3-f8ac9163c76d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.305959 Jul 26 14:52:49.034685 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 86/165] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:48 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:49.039981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-3a67b1a9-c667-474f-bc75-c15dac3515c0 req-c5210311-dbb4-4b44-bf92-687ad51a0f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef4043a-5d67-4091-abcb-ed5e596ba355", "name": "network-vif-plugged", "status": "completed", "tag": "a5d6c726-a2d1-4d56-97ab-81d623c53ac3"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:49.050875 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-3a67b1a9-c667-474f-bc75-c15dac3515c0 req-c5210311-dbb4-4b44-bf92-687ad51a0f8e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.051723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-3a67b1a9-c667-474f-bc75-c15dac3515c0 req-c5210311-dbb4-4b44-bf92-687ad51a0f8e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.066139 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-3a67b1a9-c667-474f-bc75-c15dac3515c0 req-c5210311-dbb4-4b44-bf92-687ad51a0f8e service nova] Creating event network-vif-plugged:a5d6c726-a2d1-4d56-97ab-81d623c53ac3 for instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 on hv-cinder-85103 Jul 26 14:52:49.072973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-3a67b1a9-c667-474f-bc75-c15dac3515c0 req-c5210311-dbb4-4b44-bf92-687ad51a0f8e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036869 Jul 26 14:52:49.074126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 87/166] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:49.156079 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:49.164045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5473a6c8-957c-4f0e-828e-90ebd0c31668 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.264911 Jul 26 14:52:49.164605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 80/167] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:48 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:49.612577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:49.613929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:49.622721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.623178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.623992 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.624593 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.781694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:49.789537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5d8fbcd6-7e48-44ab-87de-5853326793f3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.181242 Jul 26 14:52:49.790660 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 88/168] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:49 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:49.917635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:49.918586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:49.925890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.926532 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:49.927378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:49.927912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.066904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.067438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.074490 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.074942 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.075739 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.076178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.077576 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:50.088571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7a62faff-b4b9-4a7b-94a3-150f33d655b1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.175084 Jul 26 14:52:50.089565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 81/169] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:49 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:50.184659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.185342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.197748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.198569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.199609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.200244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.216954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:50.248293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:50.258871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9bab90e1-4348-447c-b741-71e51bf4fbb4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.202115 Jul 26 14:52:50.272659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 89/170] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:50 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:50.389052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:50.398231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1a02c21e-1f3b-40e7-8c2d-a53d4dddd0c3 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.217412 Jul 26 14:52:50.400306 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 82/171] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:50 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:50.811380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:50.811927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:50.817921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.818375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.819143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:50.819618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:50.823758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:50.991068 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:50.998654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a78c2b34-c8fc-4ca7-a9dc-bbcf8bda4820 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.191056 Jul 26 14:52:50.999587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 90/172] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:50 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:51.096484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-44452376-b26b-4927-a262-ecd00d177994 req-d38390c8-5ef7-46dc-a702-cefa007e2f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1552ebb-d614-4398-96ba-47e3fd737e3d", "name": "network-vif-plugged", "status": "completed", "tag": "f52ee38e-091f-4eb3-93dc-683dcd709ebd"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:51.106473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-44452376-b26b-4927-a262-ecd00d177994 req-d38390c8-5ef7-46dc-a702-cefa007e2f35 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.106914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-44452376-b26b-4927-a262-ecd00d177994 req-d38390c8-5ef7-46dc-a702-cefa007e2f35 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.109268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:51.110108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:51.116295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.116769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.117529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.117968 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.118329 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-44452376-b26b-4927-a262-ecd00d177994 req-d38390c8-5ef7-46dc-a702-cefa007e2f35 service nova] Creating event network-vif-plugged:f52ee38e-091f-4eb3-93dc-683dcd709ebd for instance d1552ebb-d614-4398-96ba-47e3fd737e3d on hv-cinder-85103 Jul 26 14:52:51.123376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-44452376-b26b-4927-a262-ecd00d177994 req-d38390c8-5ef7-46dc-a702-cefa007e2f35 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030571 Jul 26 14:52:51.124017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 83/173] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:51.270482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:51.278355 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8f235fbe-b8e5-41a4-98e3-51d8b791b1fe tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.172941 Jul 26 14:52:51.278921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 91/174] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:51 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:51.288343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:51.289124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:51.296138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.296667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.297527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.298032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.422642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:51.423499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:51.430207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.435058 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.436140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:51.438852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:51.485764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:51.494923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-afcb03c5-e718-4ec0-9559-37207163f647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.210652 Jul 26 14:52:51.495556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 84/175] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:51 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:51.641561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:51.649675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ebc055af-12d0-4a1b-afe6-923a6f34af27 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1314 microversion: 2.1 time: 0.232088 Jul 26 14:52:51.650543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 92/176] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:51 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:52.021102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:52.022868 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:52.027965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.028433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.029202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.029636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.240735 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:52.246142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7bd19d2d-f2cb-433a-a8fd-b24a95e41c30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.229440 Jul 26 14:52:52.247180 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 85/177] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:52 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:52.307592 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:52.308272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:52.322069 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.322535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.324353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.325105 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.500394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:52.509375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c88cef33-ebaa-432b-92ff-21bb32226609 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1322 microversion: 2.1 time: 0.213763 Jul 26 14:52:52.509953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 93/178] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:52 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:52.522418 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:52.522418 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:52.528355 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.528805 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.531199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.531696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.671093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:52.672134 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:52.677985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.678445 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.679362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:52.681461 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:52.686196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:52.703085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e8a2552c-8161-45b6-91d9-e892b44e9098 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.190957 Jul 26 14:52:52.703746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 86/179] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:52 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:52.836337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:52.845287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6db840f2-b2ae-477b-bc47-b8efbda8f8d8 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1502 microversion: 2.1 time: 0.177917 Jul 26 14:52:52.845942 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 94/180] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:52 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:53.139125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-15b2be88-e09e-4c27-bd62-6137f2197ca6 req-420d0c54-5e1c-4e99-9e00-5315ae850dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c808f60-6b5e-4ad9-8463-47c749c4ad58", "name": "network-vif-plugged", "status": "completed", "tag": "73723af2-05ec-4b78-b99d-0201637337f6"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:53.150609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-15b2be88-e09e-4c27-bd62-6137f2197ca6 req-420d0c54-5e1c-4e99-9e00-5315ae850dd4 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.151458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-15b2be88-e09e-4c27-bd62-6137f2197ca6 req-420d0c54-5e1c-4e99-9e00-5315ae850dd4 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.163266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-15b2be88-e09e-4c27-bd62-6137f2197ca6 req-420d0c54-5e1c-4e99-9e00-5315ae850dd4 service nova] Creating event network-vif-plugged:73723af2-05ec-4b78-b99d-0201637337f6 for instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 on hv-cinder-85103 Jul 26 14:52:53.168987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-15b2be88-e09e-4c27-bd62-6137f2197ca6 req-420d0c54-5e1c-4e99-9e00-5315ae850dd4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Jul 26 14:52:53.169672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 87/181] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:52:53.270881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:53.271959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:53.279700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.280287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.281517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.282246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.421759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:53.429452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dd7034a6-f955-48d1-be51-20633c1fd6b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.164870 Jul 26 14:52:53.430257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 95/182] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:53 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:53.531061 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:53.531777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:53.534905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:52:53.538451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.538893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.539683 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.540163 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.724428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:53.725299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:53.731440 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.731900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.733232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.733854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.759788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:53.768178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-af48321c-9851-4cf9-8c02-6b92fb2913c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1517 microversion: 2.1 time: 0.241393 Jul 26 14:52:53.769390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 88/183] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:53 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:53.791283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:52:53.793879 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:53.800452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.800899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.801729 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:53.802165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:53.874779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'flavor' on Instance uuid a97d630c-f890-4022-87ba-406020a397dc {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:52:53.926144 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:53.934620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-daf08993-5a80-4789-b74f-48b24492441c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.213954 Jul 26 14:52:53.935203 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 96/184] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:53 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:54.354289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-69ae8a5c-9ec0-47f6-850b-b634b55000de tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc/action" status: 200 len: 32 microversion: 2.1 time: 0.568235 Jul 26 14:52:54.354904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 89/185] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:52:53 2022] POST /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc/action => generated 32 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:52:54.370165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:54.370954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:54.377153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.377740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.378636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.379097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.453672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:54.455075 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:54.464046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.465591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.466649 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.467295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.553054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:54.561001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2893f52c-c9ae-4968-b3b9-0a1376add777 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.195363 Jul 26 14:52:54.562839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 97/186] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:54 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:54.630865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:54.639537 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7645a10e-bf44-47fc-b773-2dcead2292a8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.191772 Jul 26 14:52:54.640400 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 90/187] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:54 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:54.955180 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:54.955832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:54.962157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.962548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:54.963359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:54.963814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.121584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:55.129313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b208701e-72eb-4d02-b495-6c71db1212f5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.178303 Jul 26 14:52:55.129881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 98/188] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:54 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:55.585232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:55.585787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:55.591995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.592439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.593294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.593792 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.665214 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:55.665757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:55.672199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.672765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.673615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:55.674060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:55.726136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:55.733688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3baf9fbe-59aa-4a05-98ff-fa93cdc94c19 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.152392 Jul 26 14:52:55.734247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 91/189] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:55 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:55.806822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:55.814501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a36ac5f5-40b5-4c64-a7e8-9c7a44d48853 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.154816 Jul 26 14:52:55.815072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 99/190] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:55 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:56.150473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:56.151066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:56.157718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.158169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.158937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.159375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.294477 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:56.301972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8f8fdd6d-6113-44f9-8b60-33bfcb3d68b8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.155828 Jul 26 14:52:56.302527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 92/191] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:56 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:56.755344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:56.755914 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:56.762494 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.762940 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.764455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.764455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.835178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:56.836045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:56.842740 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.843268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.844173 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:56.844682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:56.911597 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:56.919510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-269588bb-6e44-461a-9d88-52892d52b712 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.168419 Jul 26 14:52:56.920182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 100/192] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:56 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:56.993071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:57.000942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-53493d2e-ba38-490f-8b54-aeb6441edae1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.169773 Jul 26 14:52:57.001503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 93/193] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:56 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:57.327003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:57.327003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:57.329914 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:57.330367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:57.331133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:57.331605 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:57.462808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:57.470335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d35f75d3-3efe-44b9-aff6-4be2aaa12351 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.150876 Jul 26 14:52:57.470899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 101/194] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:57 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:57.951895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:57.952511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:57.958616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:57.959073 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:57.959862 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:57.960312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.022504 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:58.023158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:58.029600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.030074 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.030907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.031365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.098033 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:58.106224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1a660a8c-7d6b-4344-80bd-5a57815fcf27 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.158194 Jul 26 14:52:58.106796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 94/195] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:57 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:58.170689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:58.178339 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5eaab2ac-2428-4c43-b580-fd4c72788fd2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.160057 Jul 26 14:52:58.178928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 102/196] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:58 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:58.496257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:58.496257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:58.498577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.499022 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.499833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:58.500267 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:58.627987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:58.636319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-61db6fc1-7aee-4103-a53a-9f2250548dbe tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1361 microversion: 2.1 time: 0.148369 Jul 26 14:52:58.636895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 95/197] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:58 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:59.127513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:59.128152 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:59.135625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.136082 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.136925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.137367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.200497 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:59.201012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:59.207431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.212850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.212850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.212850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.291269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:59.299738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-065c0e40-1682-46f9-be36-596dd04f1098 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.175975 Jul 26 14:52:59.300527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 103/198] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:59 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:59.370614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:59.378110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0f30ec31-34a9-4fc9-8355-45ab5f488019 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.182860 Jul 26 14:52:59.378672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 96/199] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:59 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:52:59.679521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:59.679521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:59.685321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.685767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.686537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.686966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.816577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:52:59.823855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-60fad783-a1ba-4224-b281-c26ca2354a9c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1547 microversion: 2.1 time: 0.149641 Jul 26 14:52:59.833634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 104/200] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:52:59 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:52:59.844625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:52:59.845155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:52:59.851235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.851733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.852502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:52:59.852942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:52:59.933164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-357d1749-1200-4bea-adda-d8e16f77e587 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092349 Jul 26 14:52:59.933773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 97/201] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:52:59 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:00.321818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:00.322994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:00.330103 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.330689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.331530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.336575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.401171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:00.401875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:00.408344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.408829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.409606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.410035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.431437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:00.498981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:00.515935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1dc84258-bff7-4629-94b4-b5382b8547ea tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.198223 Jul 26 14:53:00.516529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 105/202] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:00 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:00.554437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f701db13-b6e9-47f9-8025-0311a8d741b7"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:00.561768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:00.563665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.564194 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.565401 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:00.565525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:00.601678 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:00.611965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-de30fbd4-03a8-40ee-8426-73292543b542 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.215736 Jul 26 14:53:00.627763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 98/203] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:00 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:00.693430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:01.455950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-b61a24b4-9db9-465f-9ed2-fe926cbb96b6 req-6d24bb09-8957-4c74-b8bf-d89061ac0dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1552ebb-d614-4398-96ba-47e3fd737e3d", "tag": "f52ee38e-091f-4eb3-93dc-683dcd709ebd"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:01.466188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-b61a24b4-9db9-465f-9ed2-fe926cbb96b6 req-6d24bb09-8957-4c74-b8bf-d89061ac0dc3 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.466546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-b61a24b4-9db9-465f-9ed2-fe926cbb96b6 req-6d24bb09-8957-4c74-b8bf-d89061ac0dc3 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.477382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-b61a24b4-9db9-465f-9ed2-fe926cbb96b6 req-6d24bb09-8957-4c74-b8bf-d89061ac0dc3 service nova] Creating event network-changed:f52ee38e-091f-4eb3-93dc-683dcd709ebd for instance d1552ebb-d614-4398-96ba-47e3fd737e3d on hv-cinder-85103 Jul 26 14:53:01.483614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-b61a24b4-9db9-465f-9ed2-fe926cbb96b6 req-6d24bb09-8957-4c74-b8bf-d89061ac0dc3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031525 Jul 26 14:53:01.484250 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 99/204] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:53:01.537700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:01.538374 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:01.546464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.546917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.547723 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.548167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.678260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:01.687272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4b810d9e-bde6-4705-ae93-b03517c6c7aa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.153927 Jul 26 14:53:01.687967 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 100/205] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:01 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:01.692717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:01.693436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:01.700346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.700905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.701983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:01.702129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:01.835271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:01.845071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fed623e9-ed1a-4a0d-b57a-5d0b5119f407 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.155287 Jul 26 14:53:01.845729 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 101/206] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:01 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:02.708443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:02.709093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:02.715702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.716152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:02.716925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.717364 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:02.844328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:02.851900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ed156e1e-b22a-4e99-875a-3c8297a8eb34 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.147357 Jul 26 14:53:02.853114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 102/207] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:02 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:02.870984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:02.872281 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:02.882517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.883148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:02.883971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:02.884414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:03.017846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:03.025306 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1fd9352c-4b50-4c59-ad84-04fcc588e40f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.159566 Jul 26 14:53:03.025879 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 103/208] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:02 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:03.873414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:03.874043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:03.880543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:03.881023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:03.881814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:03.882252 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:04.009328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:04.017545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9be6b7dd-a7f8-4bf2-9673-993d1647dbaa tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.148502 Jul 26 14:53:04.018105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 104/209] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:03 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:04.046715 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:04.047323 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:04.053873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:04.054318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:04.055085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:04.055734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:04.184648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:04.192016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-97d6a888-1d56-4999-a19e-786ae8cede55 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.149202 Jul 26 14:53:04.192577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 105/210] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:04 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:05.037985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:05.038612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:05.045275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.045726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.046501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.046939 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.180481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:05.188106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c30952d2-a2a1-4399-a7b6-9088ad23c30a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.154036 Jul 26 14:53:05.188687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 106/211] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:05 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:05.212757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:05.213828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:05.219622 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.220074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.220847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:05.221288 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:05.346338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:05.354370 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0a1081ac-7d50-4296-b914-9532494c50ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.144624 Jul 26 14:53:05.354927 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 107/212] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:05 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:06.209085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:06.210549 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:06.218223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.222037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.222037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.222037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.636359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:06.644168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-687cbca5-6daa-43c8-9b8a-e6d2cf551ce8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.439312 Jul 26 14:53:06.644736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 108/213] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:06 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:06.650730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:06.651966 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:06.658005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.658452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.659219 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:06.659685 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:06.750042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6cc70f22-6570-48ee-a72a-ebc89c1ef8c7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "POST /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.199308 Jul 26 14:53:06.750666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 106/214] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:53:00 2022] POST /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf/os-volume_attachments => generated 194 bytes in 6201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:53:06.795728 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:06.803853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fed6303f-a1f7-48a7-801f-fb948de0df9f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1367 microversion: 2.1 time: 0.157800 Jul 26 14:53:06.808272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 109/215] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:06 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:07.666252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:07.666869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:07.673159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.673637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:07.674412 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.674853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:07.804908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:07.813029 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1a274b04-7097-4b5a-a13c-ef5165543fe2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.151647 Jul 26 14:53:07.817731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 107/216] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:07 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:07.826731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:07.827337 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:07.833343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.833793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:07.834549 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:07.835026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:07.983437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:07.993250 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bfbf097a-3972-4524-9424-f760fd42212a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1557 microversion: 2.1 time: 0.170407 Jul 26 14:53:07.993922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 110/217] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:07 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:08.015248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:08.015788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:08.022004 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:08.022453 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:08.023219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:08.023677 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:08.116708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-60b31d23-8b48-4b9d-adb0-453221d1ff54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105282 Jul 26 14:53:08.117489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 108/218] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:53:08 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:08.833786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:08.834478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:08.840846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:08.841300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:08.842089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:08.842610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:09.005331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:09.022303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9ff9e830-6be7-4179-b532-93592c78a94b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.192325 Jul 26 14:53:09.023434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 111/219] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:08 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:09.568637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-eea3ceec-d67b-46de-a91c-b7a99bdac3e4 req-7ecd83e8-ea4f-438c-a5ab-9adf58d48f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c808f60-6b5e-4ad9-8463-47c749c4ad58", "tag": "73723af2-05ec-4b78-b99d-0201637337f6"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:09.578172 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-eea3ceec-d67b-46de-a91c-b7a99bdac3e4 req-7ecd83e8-ea4f-438c-a5ab-9adf58d48f7c service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:09.578615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-eea3ceec-d67b-46de-a91c-b7a99bdac3e4 req-7ecd83e8-ea4f-438c-a5ab-9adf58d48f7c service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:09.589466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-eea3ceec-d67b-46de-a91c-b7a99bdac3e4 req-7ecd83e8-ea4f-438c-a5ab-9adf58d48f7c service nova] Creating event network-changed:73723af2-05ec-4b78-b99d-0201637337f6 for instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 on hv-cinder-85103 Jul 26 14:53:09.594534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-eea3ceec-d67b-46de-a91c-b7a99bdac3e4 req-7ecd83e8-ea4f-438c-a5ab-9adf58d48f7c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030152 Jul 26 14:53:09.595393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 109/220] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:53:10.051132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:10.053118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:10.063021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:10.064036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:10.064818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:10.065430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:10.253661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:10.261395 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e7756b15-7b71-4ccc-b337-26cd2bab4fd7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.221387 Jul 26 14:53:10.261989 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 112/221] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:10 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:11.282933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:11.283650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:11.289741 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:11.290186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:11.290937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:11.291367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:11.418753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:11.426523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6511ac88-896d-42e2-afab-d61819a69c9e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.148136 Jul 26 14:53:11.427066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 110/222] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:11 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:12.447719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:12.448845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:12.454946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:12.455427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:12.456195 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:12.456633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:12.586152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:12.594662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f091c507-65ac-4e25-adfb-1eb7674a865c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.150839 Jul 26 14:53:12.595300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 113/223] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:12 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:13.615282 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:13.615923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:13.618409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=71 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:13.623714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:13.624224 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:13.624930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:13.625364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:13.759477 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:13.767528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bf81d334-5861-4327-bd30-3b34858a2318 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.156077 Jul 26 14:53:13.768255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 111/224] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:13 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:14.788900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:14.789647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:14.796451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:14.796867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:14.797635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:14.798072 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:14.937960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:14.945721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5649a060-2380-4105-990e-816056877216 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.160776 Jul 26 14:53:14.946307 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 114/225] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:14 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:15.968446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:15.969059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:15.976098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:15.976580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:15.977361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:15.977920 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:16.113374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:16.124035 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-89448224-1801-483b-b3b0-178cbb644687 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.160327 Jul 26 14:53:16.124604 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 112/226] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:15 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:17.144933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:17.145623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:17.152445 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:17.152980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:17.153756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:17.154254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:17.289730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:17.294229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:17.298574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-97101190-adab-4486-bad6-88d3b874e16e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.157578 Jul 26 14:53:17.299144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 115/227] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:17 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:18.320010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:18.320653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:18.327564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:18.328027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:18.328811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:18.329254 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:18.496636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:18.504367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e17b1826-6169-4894-9658-c8599600160b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.188087 Jul 26 14:53:18.504945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 113/228] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:18 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:19.524867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:19.525464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:19.531677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.532120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.532899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:19.533332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:19.664122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:19.672203 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c2ead6e5-bd50-4eeb-802e-86d695ac92eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.151546 Jul 26 14:53:19.672779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 116/229] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:19 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:20.693413 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:20.694021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:20.701688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:20.702210 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:20.702995 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:20.703463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:20.840424 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:20.852604 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6de84f94-cca9-411b-a909-09bb7c8c1e79 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.162934 Jul 26 14:53:20.853182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 114/230] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:20 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:21.874078 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:21.874692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:21.882022 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:21.883024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:21.901875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:21.901875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:22.086457 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:22.094440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8faaf620-f7fa-4af4-93db-f4e0a26863ce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.224921 Jul 26 14:53:22.095190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 117/231] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:21 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:23.115537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:23.116704 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:23.124576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:23.125285 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:23.126136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:23.126580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:23.298605 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:23.306286 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ea5a989f-69c9-4d04-bbe9-492457047651 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.195166 Jul 26 14:53:23.306857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 115/232] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:23 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:24.327601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:24.328250 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:24.334584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:24.335056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:24.335911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:24.336375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:24.466172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:24.473656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1b295877-2f18-48a4-a086-fffdbdc5066e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.150702 Jul 26 14:53:24.474228 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 118/233] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:24 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:25.493975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:25.494608 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:25.501576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:25.502013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:25.502777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:25.503208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:25.640076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:25.647551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a7c39241-c907-48e2-a90a-2678165823d2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.157384 Jul 26 14:53:25.648125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 116/234] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:25 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:26.669660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:26.670205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:26.672157 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=61 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:26.676818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.677266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.678028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.678464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.816702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:26.824210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3315df18-eeeb-456a-b217-9a11c60ed002 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.158712 Jul 26 14:53:26.824906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 119/235] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:26 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:26.853552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:26.854031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:26.861076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.861517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.862304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:26.862736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:26.890641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:53:27.415640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-aebe867c-9eb7-448d-9313-e41965ecf3bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "DELETE /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 204 len: 0 microversion: 2.1 time: 0.565492 Jul 26 14:53:27.416264 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 117/236] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:26 2022] DELETE /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:53:27.424832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:27.425436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:27.431679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.432129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:27.432888 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.433328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:27.604642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:27.613759 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-42244463-04f1-4229-a6cf-25ff9e4f9ca7 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1554 microversion: 2.1 time: 0.192432 Jul 26 14:53:27.614952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 120/237] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:27 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:27.845478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:27.846257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:27.852294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.852749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:27.853523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:27.854252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:28.006297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:28.014900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-707f1c11-a71e-40ec-9226-9d68dae32fbc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.173803 Jul 26 14:53:28.015486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 118/238] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:27 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:28.635815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:28.636487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:28.643344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:28.643875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:28.644588 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:28.645024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:28.775956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:28.785509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-87961cc5-9ab2-4b53-afda-8deca584e319 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1554 microversion: 2.1 time: 0.153893 Jul 26 14:53:28.790081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 121/239] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:28 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:29.035837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:29.036458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:29.043703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:29.044158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:29.044957 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:29.045396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:29.194316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:29.202062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8109e8ca-a6e0-4d48-a673-a0208453ad22 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.170094 Jul 26 14:53:29.215287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 119/240] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:29 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:29.807362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:29.808102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:29.814790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:29.815225 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:29.816052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:29.825854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:29.976218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:29.992089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-edf57645-cb97-4655-9f4b-1eec34762b3f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1554 microversion: 2.1 time: 0.182715 Jul 26 14:53:29.992089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 122/241] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:29 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1554 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:30.231886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:30.231886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:30.231886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:30.231886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:30.232624 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:30.232624 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:30.383931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:30.392065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fb917e87-c63a-4546-b8d1-5fcdb800c552 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.172512 Jul 26 14:53:30.392644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 120/242] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:30 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:31.008781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:31.009520 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:31.017700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.077697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.077697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.077697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.091103 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-67761f61-7c5a-4438-94cd-d809d88ad4b6 req-2844974c-5eeb-4e47-bdd1-50e22d55c180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19044933-e557-4fb7-87ca-e67b212eb6bf", "name": "network-vif-deleted", "tag": "ad48d699-f27b-41ef-82f4-21fe1b9332b8"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:31.101989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-67761f61-7c5a-4438-94cd-d809d88ad4b6 req-2844974c-5eeb-4e47-bdd1-50e22d55c180 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.102433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-67761f61-7c5a-4438-94cd-d809d88ad4b6 req-2844974c-5eeb-4e47-bdd1-50e22d55c180 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.105956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:31.108991 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:31.117922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-67761f61-7c5a-4438-94cd-d809d88ad4b6 req-2844974c-5eeb-4e47-bdd1-50e22d55c180 service nova] Creating event network-vif-deleted:ad48d699-f27b-41ef-82f4-21fe1b9332b8 for instance 19044933-e557-4fb7-87ca-e67b212eb6bf on hv-cinder-85103 Jul 26 14:53:31.119063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-efa84c82-26e2-4b73-9054-d968881a0e08 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1512 microversion: 2.1 time: 0.115384 Jul 26 14:53:31.131650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-67761f61-7c5a-4438-94cd-d809d88ad4b6 req-2844974c-5eeb-4e47-bdd1-50e22d55c180 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040367 Jul 26 14:53:31.131760 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 123/243] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:31 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1512 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:31.131840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 121/244] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:53:31.413211 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:31.414647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:31.422356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.422944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.423972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:31.424484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:31.604752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:31.621931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-aad16b5c-4275-4f08-ab1f-7e6e2bf05dce tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.211921 Jul 26 14:53:31.623349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 124/245] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:31 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:32.140861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:32.142128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:32.149767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.150213 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.150993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.151659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.250468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:32.259759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3a02b6bb-11f3-42ce-a302-c2be9de3f7a5 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1345 microversion: 2.1 time: 0.123464 Jul 26 14:53:32.271453 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 122/246] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:32 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:32.648767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:32.649483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:32.655659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.656112 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.656925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:32.657365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:32.806031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:32.822565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2165ee1d-dfa5-42cd-bd62-0e73d53dc077 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.177527 Jul 26 14:53:32.823469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 125/247] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:32 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:33.291572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:33.291572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:33.291572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.291572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:33.292335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.292335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:33.361567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:33.369587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-39571202-131b-47de-bcf2-c721b5f94c8f tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1345 microversion: 2.1 time: 0.092213 Jul 26 14:53:33.370167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 123/248] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:33 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:33.846005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:33.846884 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:33.866954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.871997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:33.873925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:33.874586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.047220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:34.058199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ecbda67b-045b-41fa-b805-fb487521f6d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.215905 Jul 26 14:53:34.071696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 126/249] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:33 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:34.399752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:34.399752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:34.408309 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:34.409075 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.410257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:34.410851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:34.604645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:34.623613 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5a5631bd-a5d2-4a2c-89c1-d430f76a33bb tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1345 microversion: 2.1 time: 0.236223 Jul 26 14:53:34.624722 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 124/250] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:34 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:35.080533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:35.085913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:35.113156 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.118830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.118830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.118830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.353189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:35.363556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3810193d-7de5-414b-8053-3fe10cf6b99c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.287249 Jul 26 14:53:35.365421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 127/251] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:35 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:35.651925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:35.655565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:35.667094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.679390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.680772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:35.687030 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:35.815983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:35.847459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e02f28a6-7fcc-456d-b126-6ae1daa51da1 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1345 microversion: 2.1 time: 0.203829 Jul 26 14:53:35.848523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 125/252] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:35 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1345 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:36.387849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:36.389702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:36.398103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.398780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:36.399790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.400421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:36.748066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:36.759142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-271b93c7-0114-40ac-84ab-bb60ec885aa2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.376961 Jul 26 14:53:36.778423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 128/253] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:36 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:36.884647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:36.886356 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:36.912282 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.912944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:36.926246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:36.929409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:37.153154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:37.182458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-706f1556-1ad7-4c99-af4d-4c961dc492dc tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1345 microversion: 2.1 time: 0.302807 Jul 26 14:53:37.183438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 126/254] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:36 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1345 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:37.786603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:37.787388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:37.794641 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:37.795107 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:37.795996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:37.796433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.164369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:38.180584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cd3ca367-b1a5-4bf0-b174-b3624a4ff40b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.398342 Jul 26 14:53:38.181278 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 129/255] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:37 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:38.219874 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:38.220603 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:38.227699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:38.228347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.229149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:38.229667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.264290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:38.264746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:38.265385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:38.316252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:38.325759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-44b8cf9a-3775-4396-a5d3-846773d2f204 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.110847 Jul 26 14:53:38.326336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 127/256] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:38 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:39.217128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:39.218259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:39.231105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.231933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.233544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.234331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.375097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:39.375785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:39.383731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.384248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.386000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.386000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.424743 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:39.431362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:39.431922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:39.432370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:39.436584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-173a076e-f822-463a-97ba-ded51a4a6423 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.228724 Jul 26 14:53:39.437604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 130/257] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:39 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:39.508838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:39.530133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d489e253-2057-425a-985e-60367b9658db tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.158718 Jul 26 14:53:39.533138 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 128/258] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:39 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:40.463475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:40.464163 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:40.472048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.472731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.473594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.474099 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.558332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:40.563749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:40.569661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.570106 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.571070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.571725 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.622435 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:40.622897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:40.623379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:40.691644 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:40.709425 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1deaf385-3e3a-4c4d-aba0-2e7bbf8222f5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.250687 Jul 26 14:53:40.716737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 131/259] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:40 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:40.761636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:40.772114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1f5ee202-e8b6-44bb-bc5b-1b083941e995 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.218304 Jul 26 14:53:40.773691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 129/260] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:40 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:41.739851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:41.741332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:41.751169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:41.751936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:41.752960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:41.753676 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:41.791734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:41.812928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:41.812928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:41.819199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:41.819915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:41.821577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:41.822334 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:41.989191 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:42.002047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-07ff2b19-7d27-4ad5-9757-0519c196a169 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.265475 Jul 26 14:53:42.004044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 132/261] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:41 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:42.092201 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:42.092901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:42.093364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:42.160268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:42.180051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e62f432b-6121-4608-8a44-1601542fd3ee tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.386922 Jul 26 14:53:42.180051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 130/262] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:41 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:43.029054 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:43.030472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:43.040881 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.044346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.045429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.047336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.208731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:43.209397 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:43.216695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.217141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.217911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.218352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.269794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:43.270421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:43.271255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:43.327905 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:43.331358 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:43.338271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f78a78bf-ac9a-46b9-b30e-fc89a55527af tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.133272 Jul 26 14:53:43.339558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 131/263] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:43 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:43.345876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-56ee833a-1ada-4d01-b986-2a24c41b9c94 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.321462 Jul 26 14:53:43.347081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 133/264] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:43 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:44.376674 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:44.377714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:44.383383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:44.389201 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:44.398135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:44.409611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:44.410305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:44.411846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:44.413118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:44.422648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:44.427236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:44.428845 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:44.432540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:44.516405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:44.517785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:44.518248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lazy-loading 'fault' on Instance uuid 19044933-e557-4fb7-87ca-e67b212eb6bf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:44.571066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '713d2a0f610d4296887b6ab9664ae5e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1bc66d9e5446758a759063544ae3e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:44.581755 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-90355fe7-2270-4e4a-99d3-5532e005461b tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 200 len: 1350 microversion: 2.1 time: 0.220230 Jul 26 14:53:44.582329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 132/265] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:44 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 1350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:44.704956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:44.713354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b07ac5a3-1620-41f6-add0-d430e4b936f6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.347794 Jul 26 14:53:44.724907 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 134/266] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:44 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:45.618578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:45.619278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:45.633018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.633018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.633018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.633018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.646676 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] HTTP exception thrown: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Request method failure captured: Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf HTTP/1.1 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-OhavLlGMjac2nlsSiHNPFF-0yF21B_Jop3ifWg0Yj7U8seFUBuuy_5pHPJIGhJIfnonbkE-FUXcks7jd39iahPOKQMbABNI9-3XlcOQt5BganY0ZWEOoIfD7rpnid8A1_GT3uurDa9iX476SrkZVh9VOS51WuW03BmyCxnzQtmLg Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:53:45.652061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ca1bc66d9e5446758a759063544ae3e7"}]}] Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 713d2a0f610d4296887b6ab9664ae5e6 Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.653634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '19044933-e557-4fb7-87ca-e67b212eb6bf'} Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:45.654430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.655539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.656630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Returning 404 to user: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:45.656630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0cd0e5df-7fa1-4a25-96db-92b9afbae843 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 404 len: 111 microversion: 2.1 time: 0.039186 Jul 26 14:53:45.656630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 133/267] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:45 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:45.740104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:45.746709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:45.760721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.761912 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.763135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.763683 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.875048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1c8006b8-fe84-4299-aaeb-a3f71db5524a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Action: 'create', calling method: .version_select at 0x7f97e6d93940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1694483227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgvE9H0eVy2W9+N4TqbBgwmZZq5zO3CunLmzrl4wDFvuQrwLD8tM2KkSywJrdI+X91azBtRmInjcnAgo5RRD+dVB+adbhJlHY803Wq20CB9KAHVkWbM0DXSGiKEJ/TrDg=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:45.901958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-1c8006b8-fe84-4299-aaeb-a3f71db5524a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Getting quotas for project e7107f9317c24cc7b972fdc6b8c01322. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:53:45.906888 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-1c8006b8-fe84-4299-aaeb-a3f71db5524a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Getting quotas for user 2ae70024479e488c90c6c1b955cb6471 and project e7107f9317c24cc7b972fdc6b8c01322. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:53:45.918348 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:45.926255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-07a5540e-e20d-4946-a3d3-894e460be523 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1523 microversion: 2.1 time: 0.195543 Jul 26 14:53:45.927390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 134/268] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:45 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:45.932226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:45.935049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:45.946411 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.946842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.947691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:45.948119 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:45.961489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] HTTP exception thrown: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Request method failure captured: Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf/os-volume_attachments HTTP/1.1 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-OhavLlGMjac2nlsSiHNPFF-0yF21B_Jop3ifWg0Yj7U8seFUBuuy_5pHPJIGhJIfnonbkE-FUXcks7jd39iahPOKQMbABNI9-3XlcOQt5BganY0ZWEOoIfD7rpnid8A1_GT3uurDa9iX476SrkZVh9VOS51WuW03BmyCxnzQtmLg Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:53:45.963682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ca1bc66d9e5446758a759063544ae3e7"}]}] Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 713d2a0f610d4296887b6ab9664ae5e6 Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.968681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'server_id': '19044933-e557-4fb7-87ca-e67b212eb6bf'} Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:45.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:45.970895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:45.972382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Returning 404 to user: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:45.972382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d9404795-ec59-4867-9670-6630ea596b8c tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036531 Jul 26 14:53:45.972382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 135/269] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:53:45 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:46.094493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1c8006b8-fe84-4299-aaeb-a3f71db5524a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.475201 Jul 26 14:53:46.095585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 135/270] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:53:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:53:46.947973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:46.948583 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:46.956295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:46.956803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:46.957664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:46.958102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.243960 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:47.255762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-df4b600a-e2cf-41cc-aaff-d62c18b83f0f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1503 microversion: 2.1 time: 0.311840 Jul 26 14:53:47.256424 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 136/271] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:46 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1503 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:47.277214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:47.277888 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:47.286574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.287222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.288080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.288523 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.478089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:47.492025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b79fc6a6-e1c1-46f4-a0f4-d219ca2cb02f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1515 microversion: 2.1 time: 0.213323 Jul 26 14:53:47.492025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 136/272] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:47 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:47.529464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:47.530194 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:47.540904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.541670 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.543005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.543811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.577005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] HTTP exception thrown: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Request method failure captured: Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: DELETE /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf HTTP/1.1 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-OhavLlGMjac2nlsSiHNPFF-0yF21B_Jop3ifWg0Yj7U8seFUBuuy_5pHPJIGhJIfnonbkE-FUXcks7jd39iahPOKQMbABNI9-3XlcOQt5BganY0ZWEOoIfD7rpnid8A1_GT3uurDa9iX476SrkZVh9VOS51WuW03BmyCxnzQtmLg Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:53:47.580062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ca1bc66d9e5446758a759063544ae3e7"}]}] Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 713d2a0f610d4296887b6ab9664ae5e6 Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.581234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '19044933-e557-4fb7-87ca-e67b212eb6bf'} Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:47.581858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.583610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.584673 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Returning 404 to user: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:47.584673 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4c1adfaf-d43f-4160-abc7-3a503dff9201 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "DELETE /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 404 len: 111 microversion: 2.1 time: 0.060426 Jul 26 14:53:47.584673 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 137/273] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:53:47 2022] DELETE /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:53:47.593568 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:47.594184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] [instance: 19044933-e557-4fb7-87ca-e67b212eb6bf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:47.600360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.600815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.601713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:47.602170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:47.621833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] HTTP exception thrown: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Request method failure captured: Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf HTTP/1.1 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-OhavLlGMjac2nlsSiHNPFF-0yF21B_Jop3ifWg0Yj7U8seFUBuuy_5pHPJIGhJIfnonbkE-FUXcks7jd39iahPOKQMbABNI9-3XlcOQt5BganY0ZWEOoIfD7rpnid8A1_GT3uurDa9iX476SrkZVh9VOS51WuW03BmyCxnzQtmLg Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:53:47.626730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ca1bc66d9e5446758a759063544ae3e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ca1bc66d9e5446758a759063544ae3e7"}]}] Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ca1bc66d9e5446758a759063544ae3e7 Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-DeleteServersTestJSON-1778071286 Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 713d2a0f610d4296887b6ab9664ae5e6 Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-DeleteServersTestJSON-1778071286-project Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.628097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '19044933-e557-4fb7-87ca-e67b212eb6bf'} Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:53:47.628842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. Jul 26 14:53:47.632505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:53:47.633563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] Returning 404 to user: Instance 19044933-e557-4fb7-87ca-e67b212eb6bf could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:53:47.633563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-aa9ec7bc-07f7-4157-99f0-b3b4aa8be658 tempest-DeleteServersTestJSON-1778071286 tempest-DeleteServersTestJSON-1778071286-project] 10.222.0.97 "GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf" status: 404 len: 111 microversion: 2.1 time: 0.039947 Jul 26 14:53:47.633563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 137/274] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:47 2022] GET /compute/v2.1/servers/19044933-e557-4fb7-87ca-e67b212eb6bf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:53:55.397888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:53:55.400837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:55.408765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:55.409368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:55.410242 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:55.410740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:55.425142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:55.434391 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'flavor' on Instance uuid 2ef4043a-5d67-4091-abcb-ed5e596ba355 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:53:55.967814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8295fb69-f186-4bc9-9921-fa4b6f148005 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/action" status: 200 len: 32 microversion: 2.1 time: 0.572926 Jul 26 14:53:55.969022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 138/275] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:53:55 2022] POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/action => generated 32 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:53:55.984839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:55.986224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:55.993443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=4 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:55.995932 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:55.996688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:55.997866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:55.998808 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:56.210673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:56.219934 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9689617e-9962-4a72-991b-66453c025f85 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.242263 Jul 26 14:53:56.227543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 138/276] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:55 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:53:57.258887 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:57.260628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:57.301123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:57.302335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:57.303851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:57.304719 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:57.498596 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:57.506115 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-23059049-81de-4439-a1df-2a40319e06f1 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.265865 Jul 26 14:53:57.506679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 139/277] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:57 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:58.529853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:58.530664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:58.532603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:53:58.537515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:58.537967 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:58.538744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:58.539367 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:58.736928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:58.750914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-37dc4517-fa70-4e1b-9387-24c713969f24 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.225838 Jul 26 14:53:58.752340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 139/278] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:58 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:53:59.780660 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:53:59.781696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:53:59.792206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:59.792767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:59.794076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:53:59.794954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:53:59.930793 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:53:59.938584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b548d0f0-5d03-40d1-8c26-2280224287ae tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.166292 Jul 26 14:53:59.939163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 140/279] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:53:59 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:00.959812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:00.960441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:00.966762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:00.971603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:00.971603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:00.971603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:01.143869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:01.152900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-76f84b20-7ae4-4b37-b813-5ea16c40a7ec tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.197100 Jul 26 14:54:01.153645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 140/280] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:00 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:02.180509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:02.181566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:02.188652 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:02.189249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:02.190303 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:02.190851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:02.337134 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:02.349280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2555f4ef-1042-48df-b8ce-e6171699870a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.173123 Jul 26 14:54:02.353766 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 141/281] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:02 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:03.378222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:03.379152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:03.387379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:03.388209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:03.390027 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:03.390779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:03.578458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:03.587196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e39e1574-e3e5-4d16-ba6c-a9cfe86393c8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.213924 Jul 26 14:54:03.588155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 141/282] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:03 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:04.613154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:04.614212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:04.625002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:04.625711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:04.627261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:04.627998 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:04.798756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:04.806782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-475732b9-58c9-4b42-ab5c-76261a759962 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.200049 Jul 26 14:54:04.807761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 142/283] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:04 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:05.827958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:05.828698 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:05.835662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:05.836142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:05.836931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:05.837369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:06.010080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:06.024532 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4a194360-50cc-4e04-aaf4-b1067a698550 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.200027 Jul 26 14:54:06.025548 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 142/284] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:05 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:07.064434 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:07.066187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:07.077136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:07.077136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:07.077136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:07.077136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:07.305833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:07.318075 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8f9f1348-0550-420a-9c10-c8031a19dd1a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.259532 Jul 26 14:54:07.318996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 143/285] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:07 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:08.353904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:08.355017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:08.366101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:08.366859 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:08.368076 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:08.368749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:08.567586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:08.580094 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-491fc6d3-5397-4ecd-8143-cb21f8a9f463 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.233185 Jul 26 14:54:08.581184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 143/286] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:08 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:09.613759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:09.614905 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:09.624218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:09.624877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:09.625963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:09.626568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:09.808278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:09.819930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b7fc3aa7-3e8d-4565-882d-83b52300938b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.212485 Jul 26 14:54:09.820769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 144/287] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:09 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:10.848373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:10.849114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:10.856090 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:10.856588 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:10.857427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:10.858473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:11.109256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:11.109256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ce625728-eaaa-462b-9444-237e0685782f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.187468 Jul 26 14:54:11.109256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 144/288] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:10 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:12.056263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:12.056797 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:12.064796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:12.065294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:12.066112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:12.066625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:12.211943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:12.220903 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9fdff075-17ec-4806-b49c-da106b668c29 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.169169 Jul 26 14:54:12.221474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 145/289] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:12 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:13.242175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:13.242807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:13.249054 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:13.249621 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:13.250630 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:13.251233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:13.256280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=65 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:13.385503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:13.393982 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-90909f6b-3322-4d63-9225-a45180bf106b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.155673 Jul 26 14:54:13.394554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 145/290] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:13 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:14.417885 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:14.419895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:14.425650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:14.426098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:14.426860 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:14.427293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:14.566262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:14.573730 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-69e3eb27-389f-4782-a00c-dcccbdd6a451 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.159920 Jul 26 14:54:14.574288 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 146/291] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:14 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:15.595569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:15.596179 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:15.602429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:15.602874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:15.603651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:15.604080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:15.777656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:15.790563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1ab30c5f-f22c-417a-9d89-c094af6a9068 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.198997 Jul 26 14:54:15.791221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 146/292] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:15 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:16.813135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:16.814170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:16.817426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=32 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:16.823499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.823958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.824796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:16.825298 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:16.957791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:16.965459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-78904f42-0f41-4cae-b24f-01f5d630c394 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.157307 Jul 26 14:54:16.966032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 147/293] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:16 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:17.986504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:17.987074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:17.993915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:17.994478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:17.995319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:17.995825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:18.140541 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:18.148278 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-86b7744d-7eac-40b1-a8e1-4945b3d104d6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.165989 Jul 26 14:54:18.148826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 147/294] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:17 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:19.170974 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:19.171536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:19.178529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:19.178981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:19.179798 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:19.180238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:19.311374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:19.318767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7c7e8f4c-1798-40d9-9000-de3d11723491 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.152197 Jul 26 14:54:19.319328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 148/295] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:19 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:20.341051 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:20.341836 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:20.348975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:20.349425 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:20.350210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:20.350662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:20.492172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:20.499656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-848ecd05-5e40-4d5d-ba15-2fc1006bdbee tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.162670 Jul 26 14:54:20.500217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 148/296] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:20 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:21.520655 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:21.521262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:21.527823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:21.528269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:21.529027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:21.529456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:21.686099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:21.693811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-397f5cb1-c1ed-41e1-8c28-81cf166437dc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.177243 Jul 26 14:54:21.694637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 149/297] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:21 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:22.714889 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:22.715551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:22.722030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:22.722507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:22.723283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:22.723750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:22.853570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:22.860999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-56954ec8-7eb6-46cb-b7bc-705338877c00 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.150141 Jul 26 14:54:22.861562 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 149/298] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:22 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:23.881902 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:23.882520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:23.889898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:23.890344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:23.891200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:23.891754 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:24.028132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:24.036742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9600b8e6-f649-4beb-9454-ff40bb01577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.158636 Jul 26 14:54:24.037340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 150/299] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:23 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:25.063514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:25.064499 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:25.073426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.074369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.075543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.076203 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.267940 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:25.283749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cd10a3c6-4c5d-4dfe-b717-d19f24c31e41 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1501 microversion: 2.1 time: 0.228590 Jul 26 14:54:25.284332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 150/300] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:25 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1501 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:25.307903 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8486ce6f-171a-4670-be2c-e470e2773643"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:25.310489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:25.317726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.318675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.319571 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.320255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.363676 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] HTTP exception thrown: Cannot 'attach_volume' instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 while it is in vm_state rescued Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Request method failure captured: Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/os-volume_attachments HTTP/1.1 Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 74 Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-PIfzinAT7j3dv57JccSfrAoVCFVjPpG63tDdFDSnC52c_acC3y6ADqFz9G26qAkZXun6SvpAH2C0ZO-InmiQ04DNJOkLRJcpJbyyIHtF_ueuNI8AIzuWIkxAkgONA_gAYkJcQ9wt_v4sz0kFRjBzbyQ60U6zhA0LHE3brfHBo5ss Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:54:25.366786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4f3f79533bbf48018798e6e65050d69c"}]}] Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 19c0408b4321495eabd4738bbb8b711b Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {"volumeAttachment": {"volumeId": "8486ce6f-171a-4670-be2c-e470e2773643"}} Jul 26 14:54:25.368142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Cannot 'attach_volume' instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 while it is in vm_state rescued Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'server_id': '2ef4043a-5d67-4091-abcb-ed5e596ba355', 'body': {'volumeAttachment': {'volumeId': '8486ce6f-171a-4670-be2c-e470e2773643'}}} Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:54:25.369051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 while it is in vm_state rescued Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:54:25.370335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 while it is in vm_state rescued Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Returning 409 to user: Cannot 'attach_volume' instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 while it is in vm_state rescued {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e5a959ad-519c-452a-b026-8eaba9b3d11c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065605 Jul 26 14:54:25.371949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 151/301] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:54:25 2022] POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:54:25.380637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:25.381137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:25.388165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.388963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.390502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.390986 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.744156 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-54e4868c-001c-4b5f-841b-c16069b40e91 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/action" status: 202 len: 0 microversion: 2.1 time: 0.367263 Jul 26 14:54:25.745215 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 151/302] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:54:25 2022] POST /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:54:25.759024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:25.760481 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:25.770839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.772081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.773131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:25.773721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:25.779253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:26.000671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:26.015876 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-297ec605-4138-4dfe-97e5-db1547b04ff9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1509 microversion: 2.1 time: 0.263216 Jul 26 14:54:26.017480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 152/303] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:25 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:27.052327 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:27.053639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:27.060112 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:27.060569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:27.061345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:27.062281 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:27.218379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:27.232069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-393029c6-5870-4d19-8283-2c03525a44d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1509 microversion: 2.1 time: 0.178786 Jul 26 14:54:27.232069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 152/304] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:27 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:28.253272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:28.253272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:28.257851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:28.261556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:28.262733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:28.263193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:28.413072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:28.420884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-674e69dc-940a-486f-8046-2a5a8045efbb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1509 microversion: 2.1 time: 0.176704 Jul 26 14:54:28.421452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 153/305] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:28 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:29.442888 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:29.443567 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:29.453754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:29.453754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:29.453754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:29.453754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:29.589070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:29.597461 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-05dce2ad-0920-4a74-8f0e-2b5e5d1be2e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1509 microversion: 2.1 time: 0.158629 Jul 26 14:54:29.598031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 153/306] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:29 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:30.621077 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:30.622475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:30.633709 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:30.634244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:30.635608 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:30.636240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:30.874884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:30.877152 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e8c8678d-ef69-4a87-bec9-2d72a710abab tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1509 microversion: 2.1 time: 0.261119 Jul 26 14:54:30.878530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 154/307] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:30 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1509 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:31.920715 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:31.921985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:31.940832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=30 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:31.940832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:31.940832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:31.940832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:31.941503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:32.129202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:32.137527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-854d69e6-0298-495b-b773-c3025c1415eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1515 microversion: 2.1 time: 0.227361 Jul 26 14:54:32.138400 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 154/308] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:31 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1515 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:32.559577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1028650876", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:32.636552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] validate_networks() for None {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:54:33.165921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:54:33.168365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:54:33.170122 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:54:33.170712 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:54:33.171374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:54:33.180601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:33.181057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:33.181902 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:33.182308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:33.200884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Getting quotas for project bd4e47dfa8ff43829da20aa31c4bb25b. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:54:33.205404 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Getting quotas for user 81d4b47691f44cab80c244a0d21542db and project bd4e47dfa8ff43829da20aa31c4bb25b. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:54:33.219115 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:54:33.221486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:54:33.345699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-15c5efb1-dcd7-479d-a8b3-594811c8c6f2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793085 Jul 26 14:54:33.352641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 155/309] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:54:33.359118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-46a5110f-1314-4322-9934-667e81bf990e tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:33.368464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-46a5110f-1314-4322-9934-667e81bf990e tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:33.524992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-46a5110f-1314-4322-9934-667e81bf990e tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:33.539486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-46a5110f-1314-4322-9934-667e81bf990e tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1215 microversion: 2.1 time: 0.185340 Jul 26 14:54:33.540496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 155/310] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:33 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1215 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:34.575506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dd0f9a03-5ec9-4047-9e69-c7066a1eae68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:34.576276 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dd0f9a03-5ec9-4047-9e69-c7066a1eae68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:34.664611 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dd0f9a03-5ec9-4047-9e69-c7066a1eae68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:34.674824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dd0f9a03-5ec9-4047-9e69-c7066a1eae68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1215 microversion: 2.1 time: 0.103614 Jul 26 14:54:34.679752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 156/311] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:34 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:35.038337 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-71e9f9f4-a4f7-4160-ac27-0b1c48ecf7dd tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: .version_select at 0x7f97e64495e0>, body: {"keypair": {"name": "tempest-keypair-505293295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4kW0Jq6E6EMeAA0PajM1i4jhhrVdEahQF4RwmkLuayNkYlYO6SR264avMn4PLUaMHozICjsk25RSwIVFuWS0HPUxFAFqR54Og0VzsH81HMeTTygoFd+8LJK2gDDJpcmQ=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:35.061344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-71e9f9f4-a4f7-4160-ac27-0b1c48ecf7dd tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for project 4f3f79533bbf48018798e6e65050d69c. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:54:35.066752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-71e9f9f4-a4f7-4160-ac27-0b1c48ecf7dd tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for user 19c0408b4321495eabd4738bbb8b711b and project 4f3f79533bbf48018798e6e65050d69c. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:54:35.245832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-71e9f9f4-a4f7-4160-ac27-0b1c48ecf7dd tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.211309 Jul 26 14:54:35.250101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 156/312] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:54:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:35.301129 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-780721906", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1694483227", "security_groups": [{"name": "tempest-secgroup-smoke-711558363"}], "block_device_mapping_v2": [{"uuid": "b5ef646c-4a84-496c-b5a3-497047a33c68", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "14f3b361-a8f4-473b-ba81-867b2d141518"}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:35.559329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] validate_networks() for [('14f3b361-a8f4-473b-ba81-867b2d141518', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:54:35.703708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:35.708178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:35.737986 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:35.742433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:35.742433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:35.742433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:35.911167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:35.927823 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ca6b0627-e106-43de-be6a-e0da8371a981 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1211 microversion: 2.1 time: 0.229289 Jul 26 14:54:35.929705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 157/313] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:35 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1211 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:36.118500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:54:36.119292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:54:36.119843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:54:36.120342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:54:36.120939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:54:36.134336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:36.135148 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:36.136906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:36.140855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:36.170387 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Getting quotas for project e7107f9317c24cc7b972fdc6b8c01322. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:54:36.174560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Getting quotas for user 2ae70024479e488c90c6c1b955cb6471 and project e7107f9317c24cc7b972fdc6b8c01322. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:54:36.240473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:54:36.242811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5ef646c-4a84-496c-b5a3-497047a33c68',volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:54:36.967636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:36.969324 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:36.976254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:36.976702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:36.977494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:36.978013 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:37.077069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:37.085994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-eca4da80-1286-46c7-a491-b55ee95ad4e0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1275 microversion: 2.1 time: 0.122762 Jul 26 14:54:37.086530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-03651ee6-3819-49ae-a99d-67b1fb722151 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.792724 Jul 26 14:54:37.086707 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 158/314] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:36 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:37.088735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 157/315] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:54:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:54:37.104965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c7529a08-fd2b-4d9d-ae3c-079fbcaae34d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:37.106287 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c7529a08-fd2b-4d9d-ae3c-079fbcaae34d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:37.204744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7529a08-fd2b-4d9d-ae3c-079fbcaae34d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:37.210003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c7529a08-fd2b-4d9d-ae3c-079fbcaae34d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1094 microversion: 2.1 time: 0.113595 Jul 26 14:54:37.222464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 159/316] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:37 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1094 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:38.112993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:38.113774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:38.130270 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:38.130851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:38.134180 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:38.134667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:38.245654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fc3bc6e8-07bb-4614-94d4-74e88b4510e1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:38.246699 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fc3bc6e8-07bb-4614-94d4-74e88b4510e1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:38.286520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:38.296815 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4a664f27-1974-454a-918c-ad2e63f66fa4 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1273 microversion: 2.1 time: 0.189785 Jul 26 14:54:38.297437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 158/317] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:38 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:38.356067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fc3bc6e8-07bb-4614-94d4-74e88b4510e1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:38.366851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fc3bc6e8-07bb-4614-94d4-74e88b4510e1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1094 microversion: 2.1 time: 0.137310 Jul 26 14:54:38.367664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 160/318] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:38 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1094 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:39.328985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:39.330161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:39.383147 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:39.384967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:39.386769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:39.387751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:39.398531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:39.398971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:39.426238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:39.427377 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:39.428930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:39.438326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:39.548874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:39.565177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a996a2ba-2f22-4727-9bf3-33cc00860715 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1144 microversion: 2.1 time: 0.180245 Jul 26 14:54:39.566160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 161/319] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:39 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1144 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:39.571709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2144191195", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0f1306c7-31e7-49e9-8b79-d9c630497063"}], "security_groups": [{"name": "tempest-securitygroup--2139180526"}], "key_name": "tempest-keypair-505293295", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:39.674935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:39.689743 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-770d29ca-cf23-4abe-9169-c46509b8b519 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.372609 Jul 26 14:54:39.701319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 159/320] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:39 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:39.855873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] validate_networks() for [('0f1306c7-31e7-49e9-8b79-d9c630497063', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:54:40.529461 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-c779b8f8-ed60-4cfe-bde5-65aeabb2a0b6 req-91fff398-35a6-49f9-a539-24aabce78ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7a01ed1-35f6-4349-bdad-2432d6237fe5", "tag": "d6caa173-64eb-4fad-b6b6-11a73fcc772a"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:40.557819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-c779b8f8-ed60-4cfe-bde5-65aeabb2a0b6 req-91fff398-35a6-49f9-a539-24aabce78ffa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.558335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-c779b8f8-ed60-4cfe-bde5-65aeabb2a0b6 req-91fff398-35a6-49f9-a539-24aabce78ffa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.576828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-c779b8f8-ed60-4cfe-bde5-65aeabb2a0b6 req-91fff398-35a6-49f9-a539-24aabce78ffa service nova] Creating event network-changed:d6caa173-64eb-4fad-b6b6-11a73fcc772a for instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 on hv-cinder-85103 Jul 26 14:54:40.586173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-c779b8f8-ed60-4cfe-bde5-65aeabb2a0b6 req-91fff398-35a6-49f9-a539-24aabce78ffa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065000 Jul 26 14:54:40.586883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 160/321] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:54:40.593982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:40.594809 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:40.603831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.605359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.606081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.607953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.754183 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:40.769546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-95e7697e-75b0-4a45-a4c5-c16d431541f6 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1192 microversion: 2.1 time: 0.173396 Jul 26 14:54:40.777211 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 161/322] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:40 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1192 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:40.787115 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:40.787759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:40.799252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.801636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.801636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.801636 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.836847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:54:40.842325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:54:40.842325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:54:40.842325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:54:40.842325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:54:40.849739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.850632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.852035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:40.856176 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:40.877330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:54:40.882595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Getting quotas for user 19c0408b4321495eabd4738bbb8b711b and project 4f3f79533bbf48018798e6e65050d69c. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:54:40.900930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:54:40.903691 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:54:41.020919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:41.033813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8bdd16cb-747a-42a7-baef-785b743ab438 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.252155 Jul 26 14:54:41.036063 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 162/323] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:40 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:41.070132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6dc41d05-cd1a-4ab5-b38f-a93ecb19377a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.502472 Jul 26 14:54:41.083296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-397ed45a-1129-498c-8ca7-1371c77ab1f2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:41.084463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-397ed45a-1129-498c-8ca7-1371c77ab1f2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:41.085101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 162/324] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:54:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:54:41.176601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-397ed45a-1129-498c-8ca7-1371c77ab1f2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:41.183694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-397ed45a-1129-498c-8ca7-1371c77ab1f2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1245 microversion: 2.1 time: 0.104607 Jul 26 14:54:41.186821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 163/325] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:41 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1245 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:41.788672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:41.789435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:41.796288 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:41.796710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:41.797478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:41.797910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:41.928938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:41.937892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5906bbb7-5cfa-481d-8ce8-5b8287c5ad02 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1210 microversion: 2.1 time: 0.152491 Jul 26 14:54:41.938458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 163/326] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:41 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1210 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:42.056856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:42.057696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:42.066287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:42.067003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:42.068055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:42.068698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:42.208569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e2ba2c53-a961-4d12-bda8-4c30b7d19320 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:42.209125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e2ba2c53-a961-4d12-bda8-4c30b7d19320 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:42.224839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:42.232954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f910e367-489b-4439-85e6-8f90df528680 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.180540 Jul 26 14:54:42.233554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 164/327] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:42 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:42.268178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2ba2c53-a961-4d12-bda8-4c30b7d19320 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:42.275049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e2ba2c53-a961-4d12-bda8-4c30b7d19320 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1245 microversion: 2.1 time: 0.070875 Jul 26 14:54:42.275649 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 164/328] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:42 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:42.959836 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:42.960573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:42.967272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:42.967761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:42.968540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:42.969026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:43.108577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:43.118246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-22069289-bfae-43fd-a079-ff728b87e5eb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1277 microversion: 2.1 time: 0.162373 Jul 26 14:54:43.118821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 165/329] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:42 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:43.254346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:43.254984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:43.261379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:43.261829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:43.262604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:43.263042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:43.297190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:43.304892 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:43.316279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:43.318543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:43.318543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:43.318543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:43.385321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:43.395092 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-53b29844-2b42-4b32-b03a-37bc09a501a4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1249 microversion: 2.1 time: 0.102758 Jul 26 14:54:43.395428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 166/330] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:43 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:43.410625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:43.423667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c59d08e2-d318-4c1d-abcb-15dc69b19011 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.170263 Jul 26 14:54:43.423667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 165/331] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:43 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:44.142439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:44.142439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:44.148528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.148980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.149787 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.150226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.295491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:44.303900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-25272691-b268-4a3a-a80b-9a815b33274a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1277 microversion: 2.1 time: 0.166902 Jul 26 14:54:44.304476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 167/332] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:44 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:44.418533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:44.423599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:44.427236 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.427787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.428803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.429462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.461965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:44.466341 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:44.467151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:44.478032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.478379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.479662 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:44.480380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:44.502061 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:44.509842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-988bdd65-a1e0-4356-8356-7a16ac070d88 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1249 microversion: 2.1 time: 0.096601 Jul 26 14:54:44.510894 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 166/333] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:44 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:44.638391 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:44.646089 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c3959ed5-31d7-4886-9852-e7b4e7e28f68 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.207194 Jul 26 14:54:44.646653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 168/334] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:44 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:45.329496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:45.330120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:45.337035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.341232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.341232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.341232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.547634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:45.548259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:45.555606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.556429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.557428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.558496 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.675130 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:45.697253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d8943d44-f760-48db-bb76-14a84d7b4845 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1249 microversion: 2.1 time: 0.154627 Jul 26 14:54:45.698446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 169/335] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:45 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1249 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:45.703601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:45.704402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:45.710497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.710947 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.711755 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:45.712188 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:45.781670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:45.812837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-32f7f572-a845-4345-a405-7459ae64e502 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1277 microversion: 2.1 time: 0.487200 Jul 26 14:54:45.819518 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 167/336] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:45 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1277 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:45.911257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:45.918471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0b243b9e-1418-4133-8d22-0860a10d9b4c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.218874 Jul 26 14:54:45.919034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 170/337] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:45 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:46.517135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-105ae5e0-74bc-4142-bd98-2302adec60e5 req-4aaace14-0e3d-40bb-8040-6d2fd61299ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171f8b78-1bb9-4ab8-9e8e-78aaf0208adb", "tag": "5dc5b800-3fb7-4da8-865c-4676b8e74a36"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:46.527279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-105ae5e0-74bc-4142-bd98-2302adec60e5 req-4aaace14-0e3d-40bb-8040-6d2fd61299ec service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.531957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-105ae5e0-74bc-4142-bd98-2302adec60e5 req-4aaace14-0e3d-40bb-8040-6d2fd61299ec service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.547753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-105ae5e0-74bc-4142-bd98-2302adec60e5 req-4aaace14-0e3d-40bb-8040-6d2fd61299ec service nova] Creating event network-changed:5dc5b800-3fb7-4da8-865c-4676b8e74a36 for instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb on hv-cinder-85103 Jul 26 14:54:46.553691 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-105ae5e0-74bc-4142-bd98-2302adec60e5 req-4aaace14-0e3d-40bb-8040-6d2fd61299ec service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041358 Jul 26 14:54:46.555045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 168/338] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:46.718328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:46.723199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:46.723199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:46.728118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.728567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.729350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.729785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.795819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:46.803517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b7cc815d-f63f-4286-9e8a-83f37e87df9b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1297 microversion: 2.1 time: 0.089155 Jul 26 14:54:46.804093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 171/339] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:46 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:46.842350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:46.843139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:46.851108 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.853793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.853793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.853793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.940437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:46.941850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:46.947679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:46.949905 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.950523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:46.951737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:46.952462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:47.135454 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:47.137790 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:47.144466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a85325c2-13e5-4f03-95d0-9a97962562c6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.208136 Jul 26 14:54:47.155382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 172/340] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:46 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:47.453188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:47.462587 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-16169cb8-c9fd-4605-b4fd-e044788e1f3d tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.623713 Jul 26 14:54:47.463409 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 169/341] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:46 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:47.829208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:47.830009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:47.837049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:47.837749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:47.838718 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:47.839485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:47.910783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:47.918379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7f2acd8a-9894-4b36-a4e4-6abc38210215 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1303 microversion: 2.1 time: 0.094389 Jul 26 14:54:47.919013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 173/342] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:47 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:48.169386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:48.170698 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:48.177721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.178351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:48.179155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.179786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:48.485968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:48.486338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:48.487849 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:48.496764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.497609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:48.498332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-47a0eea3-1c9f-4b11-8b07-a458ef3d0fc0 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.334118 Jul 26 14:54:48.498523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.499622 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:48.500371 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 170/343] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:48 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:48.714877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:48.725318 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-eb6c3fea-f55e-4635-8833-0c29a0935bb7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.244220 Jul 26 14:54:48.726555 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 174/344] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:48 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:48.943891 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:48.945544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:48.955152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.955776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:48.956578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:48.957093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:49.152849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:49.161704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-71700905-311e-40e2-9123-7b2d781a4fd3 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.225859 Jul 26 14:54:49.166386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 171/345] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:48 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:49.526020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:49.527262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:49.533905 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:49.534350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:49.535131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:49.537558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:49.675652 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:49.684065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ea28b023-03e5-4a4b-aab5-8ba41bb21e4f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.162034 Jul 26 14:54:49.684640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 175/346] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:49 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:49.746244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:49.746970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:49.753122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:49.753646 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:49.754497 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:49.755059 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:49.891703 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:49.899453 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bbd83440-4a4f-4d28-a9d1-17cdf3993229 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.157183 Jul 26 14:54:49.900109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 172/347] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:49 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:50.186157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:50.186995 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:50.193695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.194155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.194928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.195586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.363443 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:50.376800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-28a8e703-fc57-45a6-b34e-aab8cbc2cfa7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.194397 Jul 26 14:54:50.377711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 176/348] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:50 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:50.526390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-870b7511-4375-4e71-8cd7-077af2461f1e req-e5be310a-a686-47ca-9011-2e992fa54485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a01ed1-35f6-4349-bdad-2432d6237fe5", "name": "network-vif-plugged", "status": "completed", "tag": "d6caa173-64eb-4fad-b6b6-11a73fcc772a"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:50.538255 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-870b7511-4375-4e71-8cd7-077af2461f1e req-e5be310a-a686-47ca-9011-2e992fa54485 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.538815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-870b7511-4375-4e71-8cd7-077af2461f1e req-e5be310a-a686-47ca-9011-2e992fa54485 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.557944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-870b7511-4375-4e71-8cd7-077af2461f1e req-e5be310a-a686-47ca-9011-2e992fa54485 service nova] Creating event network-vif-plugged:d6caa173-64eb-4fad-b6b6-11a73fcc772a for instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 on hv-cinder-85103 Jul 26 14:54:50.563750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-870b7511-4375-4e71-8cd7-077af2461f1e req-e5be310a-a686-47ca-9011-2e992fa54485 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042765 Jul 26 14:54:50.564494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 173/349] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:50.707682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:50.709100 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:50.719527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.720877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.721888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.722644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.917897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:50.922304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:50.923344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:50.930571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.931389 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.932700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:50.934097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:50.994704 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:51.009065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-74b1286e-de2e-4e6b-b39d-40edd1644f9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.307949 Jul 26 14:54:51.010135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 177/350] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:50 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:51.336403 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:51.345496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-86713a9b-336d-496b-b9ef-5b3190c9096a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.428765 Jul 26 14:54:51.346454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 174/351] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:50 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:51.398005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:51.398694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:51.400681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=16 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:51.405393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:51.405843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:51.407243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:51.407705 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:51.544930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:51.555383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-68e6e08b-3441-42c7-b063-30ad80a4d42b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.161063 Jul 26 14:54:51.556646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 178/352] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:51 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:51.588061 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-fd6963d9-5178-4213-9d3d-634e911674a0 req-8aa200b2-ef0c-4ea5-aa47-8a40bc4270b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:54:51.601431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-fd6963d9-5178-4213-9d3d-634e911674a0 req-8aa200b2-ef0c-4ea5-aa47-8a40bc4270b9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:51.602268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-fd6963d9-5178-4213-9d3d-634e911674a0 req-8aa200b2-ef0c-4ea5-aa47-8a40bc4270b9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:51.623059 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-fd6963d9-5178-4213-9d3d-634e911674a0 req-8aa200b2-ef0c-4ea5-aa47-8a40bc4270b9 service nova] Creating event network-changed:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:54:51.630340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-fd6963d9-5178-4213-9d3d-634e911674a0 req-8aa200b2-ef0c-4ea5-aa47-8a40bc4270b9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047230 Jul 26 14:54:51.631249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 175/353] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:54:52.032470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:52.032915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:52.042020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.042020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.042020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.042020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.182824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:52.189143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-152bf62d-b01a-4a8b-b58b-b1269aa47a53 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.161093 Jul 26 14:54:52.189731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 179/354] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:52 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:52.363618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=18 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:52.367628 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:52.368380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:52.374492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.384999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.384999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.384999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.513784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:52.522015 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cbbc9917-848a-49c4-a9b3-42abeafc7b6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.159539 Jul 26 14:54:52.522581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 176/355] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:52 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:52.579775 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:52.580382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:52.587160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.587629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.588388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:52.597199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:52.726432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:52.734223 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-144bdbf0-885a-4a1e-994b-40d4f776d9b8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.159069 Jul 26 14:54:52.734882 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 180/356] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:52 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:53.210299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:53.210922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:53.216896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.222338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.222338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.222338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.344702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:53.352304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-79a76c33-6f02-4037-9056-c467d4a298ea tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1315 microversion: 2.1 time: 0.145877 Jul 26 14:54:53.352794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 177/357] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:53 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:53.543687 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:53.544299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:53.551294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.551780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.552549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.563217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.689294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:53.697177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-83a9363e-4c22-4849-980d-04e06ecff7b3 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.157386 Jul 26 14:54:53.697786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 181/358] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:53 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:53.754453 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:53.755065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:53.761336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.761801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.762603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:53.763040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:53.979733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:53.987543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d64a81ee-8983-4ff0-ab19-725b6c3f7b59 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.237236 Jul 26 14:54:53.988569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 178/359] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:53 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:54.373012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:54.373619 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:54.380498 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.380712 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.381544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.381990 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.567956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:54.576315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d30989d9-1456-4203-8d31-67718e10cb04 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1464 microversion: 2.1 time: 0.207084 Jul 26 14:54:54.576824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 182/360] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:54 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:54.622892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:54.623386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:54.629303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.630733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.630733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.631155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.656940 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:54:54.718187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:54.719364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:54.725632 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.726087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.728289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:54.729735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:54.891019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:54.898674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7e44bcbd-dd67-4678-bd60-24293b709f24 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.184405 Jul 26 14:54:54.899367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 183/361] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:54 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:55.008720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:55.010950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:55.013613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-97774850-5ae0-4ae8-9045-e90b6ecdaebe tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "DELETE /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 204 len: 0 microversion: 2.1 time: 0.391070 Jul 26 14:54:55.016774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 179/362] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:54:54 2022] DELETE /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:54:55.020342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.021110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:55.022122 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.022936 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:55.043002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:55.048772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:55.059648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.060648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:55.062098 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.064491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:55.174690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:55.182354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c8bc0ea7-d0e5-402a-9f39-c5f8e5f8a94f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.177437 Jul 26 14:54:55.182927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 184/363] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:55 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:55.236300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:55.244130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9f8c4d54-3297-4c13-a944-eb7105eef8e2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.219736 Jul 26 14:54:55.244702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 180/364] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:55 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:55.920055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:55.920662 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:55.927832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.928276 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:55.929032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:55.929463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:56.115952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:56.132392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3dee236e-abb8-4e95-a86a-d2f57d582471 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.216292 Jul 26 14:54:56.150643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 185/365] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:55 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:56.202564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:56.203462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:56.209827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:56.210320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:56.211318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:56.211854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:56.268654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:56.270056 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:56.280314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:56.280935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:56.282407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:56.283112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:56.425899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:56.433736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2612c4fc-076c-48ef-8744-a0025f0cd14c tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.170438 Jul 26 14:54:56.434305 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 186/366] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:56 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:56.447221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:56.454915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1b7cecd2-cd74-470b-a323-b8e871d0f35f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.256310 Jul 26 14:54:56.455501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 181/367] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:56 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:57.158261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:57.158921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:57.165359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.165814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.166590 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.167038 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.306470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:57.315542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d59cee1a-02ad-4384-8af1-3eee903132a9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.161180 Jul 26 14:54:57.316870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 187/368] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:57 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:57.455064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:57.455701 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:57.461739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.462191 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.463023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.463503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.475987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:57.476900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:57.485313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.485776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.490573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:57.490573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:57.600784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:57.608468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0f6e45e2-45a8-43b8-a7b0-f35b0db13e51 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.157456 Jul 26 14:54:57.609035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 182/369] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:57 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:57.654767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:57.663683 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-37558501-8465-4666-9512-9bd6dcea327f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.191554 Jul 26 14:54:57.664296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 188/370] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:57 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:58.337274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:58.338101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:58.344553 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.345185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.346131 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.346797 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.369898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:58.489147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:58.496839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4547e378-d611-4dd7-865b-8393aa815de9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.163388 Jul 26 14:54:58.497405 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 183/371] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:58 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:58.631241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:58.632466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:58.639498 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.640213 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.641557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.642175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.661313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:58.705039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:58.705638 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:58.707478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:54:58.712273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.712720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.713487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:58.713921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:58.784858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:58.793035 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-de366233-1bca-4a41-9c54-025edcf2423f tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.166195 Jul 26 14:54:58.793814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 189/372] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:58 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:58.846827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:58.855275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-97033db5-6dbf-463d-8bab-4cc836f83cef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.154122 Jul 26 14:54:58.856128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 184/373] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:58 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:54:59.525235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:59.525880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:59.532664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.533114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.533885 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.534317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.669006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:59.677324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b23d98ef-cb3c-4e31-89d4-992e00edbcd2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.156352 Jul 26 14:54:59.677985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 190/374] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:59 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:54:59.815913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:59.816519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:59.823659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.824113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.824885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.825323 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.878484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:54:59.879931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:54:59.887959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.890491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.891548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:54:59.892219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:54:59.990184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:54:59.996910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5129d509-029b-4a1e-b4ab-45fa406d00f1 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.185082 Jul 26 14:54:59.997677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 185/375] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:59 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:00.044279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:00.053011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b1af15e7-44a1-4fbd-85ae-973968f491eb tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.180230 Jul 26 14:55:00.056206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 191/376] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:54:59 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:00.699264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:00.699900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:00.707742 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:00.708188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:00.709293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:00.709731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:00.845221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:00.853021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a2decbf3-3891-459e-b265-5fba4a0523f9 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.158342 Jul 26 14:55:00.853731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 186/377] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:00 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:01.020533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:01.021057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:01.027265 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.027750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.032414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.032414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.074373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:01.074999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:01.081985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.082439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.083222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.083683 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.170498 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:01.178410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-89d43d25-efa2-43ef-bf48-bd854a75ad42 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.164010 Jul 26 14:55:01.179450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 192/378] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:01 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:01.223110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:01.230606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-45d5567b-c899-43cc-8342-a8fd94eb5465 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.160171 Jul 26 14:55:01.231137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 187/379] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:01 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:01.320327 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-4dbeef6c-4264-449c-81f2-e49476492487 req-ce1ea5b5-6898-42e5-b2d9-1ecc9b6bd9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "name": "network-vif-plugged", "status": "completed", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:01.330990 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4dbeef6c-4264-449c-81f2-e49476492487 req-ce1ea5b5-6898-42e5-b2d9-1ecc9b6bd9a6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.331544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4dbeef6c-4264-449c-81f2-e49476492487 req-ce1ea5b5-6898-42e5-b2d9-1ecc9b6bd9a6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.342989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-4dbeef6c-4264-449c-81f2-e49476492487 req-ce1ea5b5-6898-42e5-b2d9-1ecc9b6bd9a6 service nova] Creating event network-vif-plugged:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:55:01.348321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-4dbeef6c-4264-449c-81f2-e49476492487 req-ce1ea5b5-6898-42e5-b2d9-1ecc9b6bd9a6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Jul 26 14:55:01.349543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 193/380] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:01.874459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:01.876368 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:01.883107 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.883668 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:01.884528 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:01.885045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:02.025856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:02.033350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-969ae95b-69ff-44c6-9d92-29f0c5fe71c1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.162966 Jul 26 14:55:02.033916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 188/381] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:01 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:02.200928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:02.201618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:02.209414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:02.210145 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:02.211366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:02.211830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:02.251791 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:02.252509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:02.259358 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:02.260190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:02.260970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:02.261411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:02.354142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:02.362774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d0965082-0457-4031-9484-9148ff685493 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.166019 Jul 26 14:55:02.366421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 194/382] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:02 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:02.400613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:02.408479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-90a73301-78c2-42b0-8a84-335d94002c01 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.160782 Jul 26 14:55:02.409125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 189/383] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:02 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:03.056507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:03.057241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:03.064431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.069808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.069808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.069808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.212868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:03.221348 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-82503a32-05cb-486e-81ec-c24b2ff1d175 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.168859 Jul 26 14:55:03.227525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 195/384] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:03 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:03.384953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:03.385690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:03.392335 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.392883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.393752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.394300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.430149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:03.430758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:03.436844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.437294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.438668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:03.439102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:03.532729 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:03.549834 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c0786e04-a5af-4d3e-8270-18e696d52c05 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.168214 Jul 26 14:55:03.550828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 190/385] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:03 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:03.601044 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:03.608757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ccadc0b3-b170-452d-b044-6b305f8ed308 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.182364 Jul 26 14:55:03.610162 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 196/386] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:03 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:04.242657 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:04.243334 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:04.254144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.254711 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.255773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.256257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.571823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:04.573093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:04.580706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.581313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.582390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.582826 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.588003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:04.597247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c9bc651d-64f3-4bdc-abd7-763cf7f23b11 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.358741 Jul 26 14:55:04.598142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 191/387] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:04 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:04.630424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:04.634553 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:04.638299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.638746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.639742 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.640439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.749001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:04.758354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e36d8232-03f2-4aef-9714-64bfa34c5aa6 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1470 microversion: 2.1 time: 0.190256 Jul 26 14:55:04.759529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 197/388] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:04 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1470 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:04.841944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:04.852802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7602c0fd-d2b8-40ba-beb2-f6ed207e042f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1371 microversion: 2.1 time: 0.226216 Jul 26 14:55:04.860304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 192/389] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:04 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:04.899426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-4bfaee57-f3e9-4de4-a020-9c8ca809af92 req-da2442f7-4efe-4a3d-883c-31920aabad27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7a01ed1-35f6-4349-bdad-2432d6237fe5", "name": "network-vif-deleted", "tag": "d6caa173-64eb-4fad-b6b6-11a73fcc772a"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:04.912628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4bfaee57-f3e9-4de4-a020-9c8ca809af92 req-da2442f7-4efe-4a3d-883c-31920aabad27 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:04.913137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-4bfaee57-f3e9-4de4-a020-9c8ca809af92 req-da2442f7-4efe-4a3d-883c-31920aabad27 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:04.953141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-4bfaee57-f3e9-4de4-a020-9c8ca809af92 req-da2442f7-4efe-4a3d-883c-31920aabad27 service nova] Creating event network-vif-deleted:d6caa173-64eb-4fad-b6b6-11a73fcc772a for instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 on hv-cinder-85103 Jul 26 14:55:04.963027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-4bfaee57-f3e9-4de4-a020-9c8ca809af92 req-da2442f7-4efe-4a3d-883c-31920aabad27 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067460 Jul 26 14:55:04.963416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 198/390] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:05.619169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:05.620394 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:05.626717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.627173 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.630876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.630876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.783214 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:05.784647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:05.785533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:05.800656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d34d60f7-00c2-4da7-a44e-e06b8d8cebeb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.179415 Jul 26 14:55:05.800656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 193/391] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:05 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:05.800907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.800907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.800907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.800907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.835831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.836373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.836835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lazy-loading 'fault' on Instance uuid a7a01ed1-35f6-4349-bdad-2432d6237fe5 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:55:05.882043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:05.882654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:05.887211 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:05.895244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.895717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.896494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:05.896816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-80f210ee-e2ce-4dd7-98e3-c98f69702a91 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1305 microversion: 2.1 time: 0.119978 Jul 26 14:55:05.897019 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:05.897395 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 199/392] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:05 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:06.008136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-6e9a0400-b50b-434d-ab9a-b66c8a0f0c99 req-8b2f6de7-387f-4cb9-a633-12cca95d7676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171f8b78-1bb9-4ab8-9e8e-78aaf0208adb", "name": "network-vif-plugged", "status": "completed", "tag": "5dc5b800-3fb7-4da8-865c-4676b8e74a36"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:06.022259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-6e9a0400-b50b-434d-ab9a-b66c8a0f0c99 req-8b2f6de7-387f-4cb9-a633-12cca95d7676 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.022710 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-6e9a0400-b50b-434d-ab9a-b66c8a0f0c99 req-8b2f6de7-387f-4cb9-a633-12cca95d7676 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.034751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-6e9a0400-b50b-434d-ab9a-b66c8a0f0c99 req-8b2f6de7-387f-4cb9-a633-12cca95d7676 service nova] Creating event network-vif-plugged:5dc5b800-3fb7-4da8-865c-4676b8e74a36 for instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb on hv-cinder-85103 Jul 26 14:55:06.039360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:06.045544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-6e9a0400-b50b-434d-ab9a-b66c8a0f0c99 req-8b2f6de7-387f-4cb9-a633-12cca95d7676 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041061 Jul 26 14:55:06.046207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 200/393] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:55:06.057353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8ef08598-8f9d-44ca-b921-ab6e3717d73c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1565 microversion: 2.1 time: 0.171579 Jul 26 14:55:06.057353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 194/394] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:05 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:06.078901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:06.079515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:06.085879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.090694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.090694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.090694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.170470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d23a4d3b-309f-4e25-9ba7-7c93389b83c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095799 Jul 26 14:55:06.171296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 201/395] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:55:06 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:06.821894 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:06.822431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:06.829443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.829892 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.830661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.831099 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.921044 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:06.921542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:06.928676 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.929365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.930192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.930650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.966816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:06.967257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:06.967742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lazy-loading 'fault' on Instance uuid a7a01ed1-35f6-4349-bdad-2432d6237fe5 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:55:07.011829 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d4b47691f44cab80c244a0d21542db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd4e47dfa8ff43829da20aa31c4bb25b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:07.020414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-19e6f67a-44bc-4cab-a22d-839ab343acd2 tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 200 len: 1305 microversion: 2.1 time: 0.104720 Jul 26 14:55:07.021065 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 202/396] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:06 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:55:07.180897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:07.188942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-46b79628-9ba0-449e-95e4-ba051f4ad8dc tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.371150 Jul 26 14:55:07.189505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 195/397] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:06 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:07.483187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-04cb99a5-0506-4279-a5af-3e5062833014 req-729c2d57-fbbd-4074-a300-9627b32bb342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:07.494252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-04cb99a5-0506-4279-a5af-3e5062833014 req-729c2d57-fbbd-4074-a300-9627b32bb342 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:07.496051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-04cb99a5-0506-4279-a5af-3e5062833014 req-729c2d57-fbbd-4074-a300-9627b32bb342 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:07.506357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-04cb99a5-0506-4279-a5af-3e5062833014 req-729c2d57-fbbd-4074-a300-9627b32bb342 service nova] Creating event network-changed:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:55:07.513167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-04cb99a5-0506-4279-a5af-3e5062833014 req-729c2d57-fbbd-4074-a300-9627b32bb342 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033726 Jul 26 14:55:07.513855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 203/398] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:08.042049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:08.042611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] [instance: a7a01ed1-35f6-4349-bdad-2432d6237fe5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:08.049161 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:08.049616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:08.050413 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:08.050856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:08.073547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] HTTP exception thrown: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Request method failure captured: Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 HTTP/1.1 Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AAkBEERkCs8lM1tsGMRxO9SAP53mPMKfhltvWhcjeaEF_JWTUB-meKOUTdkCzSUYNNFDxTMUIZdKwLVDqr1OmuKcH1h0TGDPskpwutyq40JSQvwUvzA29r5Sn05Ixjl-8nJC5gJEdCSPqU-rwrIYHnIAmW1xFCXuVm9u869ZzhWXuQ Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: bd4e47dfa8ff43829da20aa31c4bb25b Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesNegativeTest-361120211 Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:55:08.075351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_bd4e47dfa8ff43829da20aa31c4bb25b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/bd4e47dfa8ff43829da20aa31c4bb25b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/bd4e47dfa8ff43829da20aa31c4bb25b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/bd4e47dfa8ff43829da20aa31c4bb25b"}]}] Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesNegativeTest-361120211 Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: bd4e47dfa8ff43829da20aa31c4bb25b Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesNegativeTest-361120211 Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesNegativeTest-361120211-project Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 81d4b47691f44cab80c244a0d21542db Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesNegativeTest-361120211-project Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. Jul 26 14:55:08.077503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'a7a01ed1-35f6-4349-bdad-2432d6237fe5'} Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:55:08.082511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. Jul 26 14:55:08.083750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:55:08.084858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] Returning 404 to user: Instance a7a01ed1-35f6-4349-bdad-2432d6237fe5 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:55:08.084858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f6fc5ce9-b95d-4e57-a358-5c73159c5d9b tempest-VolumesNegativeTest-361120211 tempest-VolumesNegativeTest-361120211-project] 10.222.0.97 "GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5" status: 404 len: 111 microversion: 2.1 time: 0.040074 Jul 26 14:55:08.084858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 196/399] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:08 2022] GET /compute/v2.1/servers/a7a01ed1-35f6-4349-bdad-2432d6237fe5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:55:08.211729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:08.212432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:08.218626 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:08.219122 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:08.219939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:08.220377 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:08.455016 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:08.464102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6679b767-e676-49f3-af74-29c0d07d10b7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1265 microversion: 2.1 time: 0.256958 Jul 26 14:55:08.480837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 204/400] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:08 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:09.485158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:09.485764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:09.491699 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:09.492371 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:09.493129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:09.493841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:09.693331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:09.707987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b8ee7a38-8592-4cea-9164-44470c6a6ace tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1452 microversion: 2.1 time: 0.226543 Jul 26 14:55:09.708562 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 197/401] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:09 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1452 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:09.742267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:09.742267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:09.742267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:09.742267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:09.743051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:09.744720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:09.887058 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:55:09.894885 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4952dc79-3ada-47af-9acf-cf3ba45fddb8 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1452 microversion: 2.1 time: 0.168539 Jul 26 14:55:09.895475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 205/402] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:55:09 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:55:13.017128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-7ed6ff0d-6445-4b8b-a0fe-894253b00586 req-20c2d339-c27f-4374-88bd-22d95202efe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171f8b78-1bb9-4ab8-9e8e-78aaf0208adb", "tag": "5dc5b800-3fb7-4da8-865c-4676b8e74a36"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:13.028037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-7ed6ff0d-6445-4b8b-a0fe-894253b00586 req-20c2d339-c27f-4374-88bd-22d95202efe0 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:13.032829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-7ed6ff0d-6445-4b8b-a0fe-894253b00586 req-20c2d339-c27f-4374-88bd-22d95202efe0 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:13.041750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-7ed6ff0d-6445-4b8b-a0fe-894253b00586 req-20c2d339-c27f-4374-88bd-22d95202efe0 service nova] Creating event network-changed:5dc5b800-3fb7-4da8-865c-4676b8e74a36 for instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb on hv-cinder-85103 Jul 26 14:55:13.048006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-7ed6ff0d-6445-4b8b-a0fe-894253b00586 req-20c2d339-c27f-4374-88bd-22d95202efe0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035114 Jul 26 14:55:13.048903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 198/403] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:13.439472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:55:13.439956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 14:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:55:37.798246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=71 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:37.804458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=85 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:37.965642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fa939bba-da3d-4ac9-8f11-538e40da0908 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Action: 'create', calling method: .version_select at 0x7f97e6401a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1833507386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOf0s4KViLJUtHZt8hkU+nlYFiza3l6SrL5Kc+BbJ6QsLB6r6KLii0vvxZPXzKlP9uxdz+7+pXqTyTmFYsEouKB+woGK3B3axSk3XpLm8zE30H12M9CyMfT35kyiGVnGg=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:37.981987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-fa939bba-da3d-4ac9-8f11-538e40da0908 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Getting quotas for project fde004be36ee4efeaa9ada32b4e2182c. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:55:37.986515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-fa939bba-da3d-4ac9-8f11-538e40da0908 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Getting quotas for user 29225fc9f22f4ec7b2979334760fc5ea and project fde004be36ee4efeaa9ada32b4e2182c. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:55:38.133312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fa939bba-da3d-4ac9-8f11-538e40da0908 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.340729 Jul 26 14:55:38.133908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 206/404] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:55:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:39.385134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=29 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:39.385856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=85 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:39.389986 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:39.390569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:39.397506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:39.397897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:39.398660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:39.399106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:39.423296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-40613f99-a900-4593-8a8c-c790eac5d95d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/ips" status: 200 len: 146 microversion: 2.1 time: 0.039625 Jul 26 14:55:39.423904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 199/405] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 14:55:39 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:47.004037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ca5f48a-b79d-45ce-b0a1-5b41aa11810d"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:47.007477 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:47.014869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:47.015333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:47.016170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:47.016579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:47.685671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:55:47.686200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:47.693938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:47.694446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:47.695204 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:47.695672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:47.720179 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7cb25216-7258-4368-81ce-8f0a1d291bd3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/ips" status: 200 len: 149 microversion: 2.1 time: 0.038466 Jul 26 14:55:47.720945 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 200/406] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 14:55:47 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:55:47.993531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:55:48.159863 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-80d9b60b-2485-49f5-af96-021c5f8b05d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.160996 Jul 26 14:55:48.160521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 207/407] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:55:46 2022] POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments => generated 194 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:55:50.682056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc875573-aa33-4981-8d82-98b3ecd84ee1"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:55:50.684556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:55:50.691534 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:50.691992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:50.692769 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:55:50.693212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:55:51.953044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5c250894-c10a-4bc3-84b5-2aa30e37fd8c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.274855 Jul 26 14:55:51.957876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 201/408] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:55:50 2022] POST /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments => generated 194 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:05.709190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:05.710023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:05.714163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b3b9fdd8-d547-4082-858a-d16a1ddb71c9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:05.721722 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3b9fdd8-d547-4082-858a-d16a1ddb71c9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:05.728024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3b9fdd8-d547-4082-858a-d16a1ddb71c9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:05.782107 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b3b9fdd8-d547-4082-858a-d16a1ddb71c9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Going to try to stop instance {{(pid=124889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:56:05.993191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b3b9fdd8-d547-4082-858a-d16a1ddb71c9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.285121 Jul 26 14:56:05.993800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 208/409] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:56:05 2022] POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:56:05.999913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.000671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:06.005460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:06.006274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:06.012536 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:06.012988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:06.013759 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:06.014198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:06.146675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:06.154747 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-defc6543-cc04-4be9-b3a9-42f849ffbdb5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.156436 Jul 26 14:56:06.155300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 202/410] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:05 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:07.176665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:07.177340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:07.185315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:07.185774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:07.186548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:07.187070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:07.320696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:07.328824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-630a858d-5690-49e3-8d23-fc1f6157d432 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.156850 Jul 26 14:56:07.330037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 209/411] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:07 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:08.354122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:08.354725 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:08.362606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:08.363069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:08.363827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:08.364264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:08.492109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:08.500167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-042b7784-1119-4b28-9c8f-1a5fe4437251 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.150543 Jul 26 14:56:08.500740 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 203/412] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:08 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:09.524231 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:09.524950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:09.533788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:09.534383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:09.535215 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:09.535677 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:09.667629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:09.674293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-80b62519-0f2e-405c-acc8-d6d430d6078b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.154949 Jul 26 14:56:09.674939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 210/413] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:09 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:10.695974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:10.696589 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:10.703456 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:10.703968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:10.705408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:10.705843 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:10.852576 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:10.862579 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e6584628-26c6-4f90-8435-e1bf828072cc tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.171055 Jul 26 14:56:10.863150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 204/414] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:10 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:11.884808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:11.885423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:11.892539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:11.896989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:11.896989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:11.896989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:12.066208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:12.074901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ba5f6eb1-18c9-43d0-a5bc-423bf549f82f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.193333 Jul 26 14:56:12.077216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 211/415] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:11 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:13.100904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:13.101509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:13.108234 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:13.108695 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:13.109508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:13.109916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:13.245096 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:13.253840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-07e08b6d-2f0a-4e08-a694-464a998348d0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.156993 Jul 26 14:56:13.254549 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 205/416] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:13 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:14.275563 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:14.276167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:14.283085 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:14.283564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:14.284330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:14.284763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:14.415043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:14.423022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-68225daf-f30a-4845-808f-c1702a6bf00e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.151358 Jul 26 14:56:14.424236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 212/417] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:14 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:15.445004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:15.445550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:15.452102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:15.452552 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:15.453318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:15.453757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:15.589756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:15.597643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bbeebb1b-7d8e-4e78-8109-f7dac72c99fd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.156646 Jul 26 14:56:15.598227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 206/418] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:15 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:16.619082 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:16.619756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:16.626782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:16.627240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:16.628045 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:16.628483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:16.759273 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:16.768475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9ce2aff4-8f72-425d-bfec-8ddf90f6b4ac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.153118 Jul 26 14:56:16.769313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 213/419] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:16 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:17.790504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:17.791110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:17.797743 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:17.798264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:17.799083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:17.799541 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:17.937132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:17.945559 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-47bbd985-a1ee-4b99-b9e0-6c3f0865b4d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.158906 Jul 26 14:56:17.946144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 207/420] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:17 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:18.967160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:18.967799 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:18.975049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:18.975459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:18.976251 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:18.976693 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:19.105759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:19.113906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e40682ee-935c-4295-8faf-1635a6bf52e9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.150530 Jul 26 14:56:19.114479 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 214/421] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:18 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:20.134632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:20.135239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:20.141405 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:20.141853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:20.142653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:20.143095 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:20.281679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:20.286180 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-dae4fc68-e796-4aad-94a0-87726022236e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.155920 Jul 26 14:56:20.286741 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 208/422] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:20 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:20.912053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5f238ee4-ba36-4b58-9209-f76b4c24785b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: .version_select at 0x7f97e65bfa60>, body: {"keypair": {"name": "tempest-keypair-1615510651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpQls62dmxd2syzvJJNNsdpk54hHZjCdZSDCX9/OcF9NYsEjGoBwKo7/ENTq11BPxLm6JaKag1T3x1i4/EQsF8zhczv2kHUJWgwT5KfTFTTSnDDigkPIa/00ClNxIVY+A=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:20.927711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-5f238ee4-ba36-4b58-9209-f76b4c24785b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:56:20.931707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-5f238ee4-ba36-4b58-9209-f76b4c24785b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:56:21.054178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5f238ee4-ba36-4b58-9209-f76b4c24785b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146513 Jul 26 14:56:21.055205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 215/423] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:56:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:21.309017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:21.309714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:21.316703 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:21.317270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:21.318113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:21.318682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:21.761328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:21.773873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fb92f97c-ca19-4c3f-9d8d-478e353b27cb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.469396 Jul 26 14:56:21.774460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 209/424] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:21 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:22.796153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:22.796773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:22.804893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:22.810050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:22.810050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:22.810050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:22.945472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:22.953550 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ce8b9719-798d-4131-8fcd-ecd86c0fc629 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.161791 Jul 26 14:56:22.954114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 216/425] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:22 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:23.627182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-856472989", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0"}], "security_groups": [{"name": "tempest-securitygroup--1285580422"}], "key_name": "tempest-keypair-1615510651", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:23.738280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] validate_networks() for [('4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:56:23.974251 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:23.974860 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:23.981600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:23.982049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:23.982817 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:23.983248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.115482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:24.124444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cdb7f30d-9703-413a-825e-94380ff91bec tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.154026 Jul 26 14:56:24.125104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 217/426] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:23 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:24.126820 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:56:24.127257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:56:24.127796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:56:24.128239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:56:24.128646 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:56:24.143452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.149179 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.149179 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:24.149179 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:24.162461 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:56:24.166571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:56:24.179649 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:56:24.182756 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:56:24.341414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-967838e6-8f88-4307-8b22-1e18e3937c8b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718858 Jul 26 14:56:24.344606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 210/427] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:56:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:56:24.354834 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d2940fbb-ea6b-4f60-ab80-e8acae6c005e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:24.355699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d2940fbb-ea6b-4f60-ab80-e8acae6c005e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:24.414215 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d2940fbb-ea6b-4f60-ab80-e8acae6c005e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:24.422551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d2940fbb-ea6b-4f60-ab80-e8acae6c005e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1241 microversion: 2.1 time: 0.072134 Jul 26 14:56:24.423632 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 218/428] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:24 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:25.147252 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:25.147982 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:25.156312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.156857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.159669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.159669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.289346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:25.297418 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e6edbe61-4ff8-4ca2-8fed-e6cd09e987fa tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.154919 Jul 26 14:56:25.299085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 211/429] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:25 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:25.444775 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:25.445381 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:25.456121 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.456579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.457366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:25.457816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:25.523443 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:25.530862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9dccbe4b-62c2-44c3-8f4f-4db1956407ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1245 microversion: 2.1 time: 0.090088 Jul 26 14:56:25.531443 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 219/430] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:25 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:26.319595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:26.320115 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:26.326717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.327174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.327972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.328415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.461470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:26.469468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0bca93b9-9136-4616-9b2b-17ec2a79ae11 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.153986 Jul 26 14:56:26.470552 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 212/431] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:26 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:26.552633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:26.553476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:26.560399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.560849 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.561627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:26.562084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:26.630621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:26.639324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0dc9ddd2-b14b-4d23-a61e-1b5d920d063d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1293 microversion: 2.1 time: 0.090563 Jul 26 14:56:26.639922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 220/432] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:26 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:27.492692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:27.493240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:27.500114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.500567 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.501900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.502372 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.662831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:27.663462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:27.670078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.670522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.671290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:27.671748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:27.716671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:27.726039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-79a75292-a25f-4a08-90bd-ccd9c2d70929 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.237636 Jul 26 14:56:27.726624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 213/433] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:27 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:27.739946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:27.747761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-425f0985-119e-46d1-afe1-3befc9e8c148 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1299 microversion: 2.1 time: 0.088930 Jul 26 14:56:27.748278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 221/434] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:27 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:28.748116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:28.749486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:28.758058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.758519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.759320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.760376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.771724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:28.772167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:28.781741 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.782917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.783995 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:28.785257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:28.967030 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:28.976586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-84511f21-df6a-46fa-bd61-f9fe783492b9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.210679 Jul 26 14:56:28.990539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 222/435] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:28 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:28.991032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:28.991032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0bdde2c1-9310-4e02-bc44-e00c6e5ec21e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.244525 Jul 26 14:56:28.991032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 214/436] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:28 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:29.128898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-cf64cf7d-2e09-494d-b33e-abbd097123d9 req-b3075d46-9cb3-4128-998a-2a5a7a224848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5646d5b5-6207-4584-bf5b-be1d1c6904c5", "tag": "f0eafead-2868-4633-b117-bf601471eb13"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:29.140017 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-cf64cf7d-2e09-494d-b33e-abbd097123d9 req-b3075d46-9cb3-4128-998a-2a5a7a224848 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:29.140482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-cf64cf7d-2e09-494d-b33e-abbd097123d9 req-b3075d46-9cb3-4128-998a-2a5a7a224848 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:29.153233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-cf64cf7d-2e09-494d-b33e-abbd097123d9 req-b3075d46-9cb3-4128-998a-2a5a7a224848 service nova] Creating event network-changed:f0eafead-2868-4633-b117-bf601471eb13 for instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 on hv-cinder-85103 Jul 26 14:56:29.158841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-cf64cf7d-2e09-494d-b33e-abbd097123d9 req-b3075d46-9cb3-4128-998a-2a5a7a224848 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033819 Jul 26 14:56:29.159698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 223/437] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:56:29.998462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:29.999180 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:30.006803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:30.007265 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:30.008124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:30.008752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:30.014198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:30.015569 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:30.028110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:30.028571 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:30.035671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:30.037448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:30.174056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:30.181595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-541e95a6-8dbd-495b-ba45-56e9522919da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.187216 Jul 26 14:56:30.182155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 215/438] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:29 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:30.197893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:30.206787 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1b61984c-a2dc-42e2-a326-5df4ef04ea53 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.197755 Jul 26 14:56:30.207380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 224/439] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:30 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:31.016524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1386793670", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1833507386", "security_groups": [{"name": "tempest-secgroup-smoke-2055757842"}], "networks": [{"uuid": "4f224720-dd50-4b3d-ae12-e0978ae6cbaf"}], "block_device_mapping_v2": [{"uuid": "bea79d69-1f18-4b45-984b-eb9e3139153c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:31.148675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] validate_networks() for [('4f224720-dd50-4b3d-ae12-e0978ae6cbaf', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:56:31.203979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:31.205329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:31.211816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.212371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.213245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.213688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.366187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:31.374723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3556060b-12c7-44a3-9964-408a279ee026 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.174917 Jul 26 14:56:31.375384 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 225/440] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:31 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:31.393364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:31.393971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:31.401439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.405956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.405956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.405956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.408853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:31.550378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:31.558737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cdd0c5aa-b2f7-4873-bed7-cc8f854987d9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.182070 Jul 26 14:56:31.559557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 226/441] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:31 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:31.574825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:56:31.575247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:56:31.575772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:56:31.576349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:56:31.576853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:56:31.586474 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.586914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.587858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:31.588348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:31.607376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Getting quotas for project fde004be36ee4efeaa9ada32b4e2182c. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:56:31.611386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Getting quotas for user 29225fc9f22f4ec7b2979334760fc5ea and project fde004be36ee4efeaa9ada32b4e2182c. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:56:31.671600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:56:31.673661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bea79d69-1f18-4b45-984b-eb9e3139153c',volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:56:32.094743 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-59c1e368-91f6-4649-8fef-4be569ba0947 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.082016 Jul 26 14:56:32.095612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 216/442] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:56:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:56:32.106567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9cdb3960-d1f4-4ee1-b935-9461732bc7c4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.107844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9cdb3960-d1f4-4ee1-b935-9461732bc7c4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:32.165601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9cdb3960-d1f4-4ee1-b935-9461732bc7c4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:32.174140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9cdb3960-d1f4-4ee1-b935-9461732bc7c4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1089 microversion: 2.1 time: 0.070815 Jul 26 14:56:32.174720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 227/443] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1089 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:32.395684 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.396250 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:32.403061 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.403552 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.404330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.404778 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.539189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:32.547507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-05d4605d-c2b5-4f02-b681-29167d51fc77 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.156023 Jul 26 14:56:32.548068 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 217/444] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:32.581859 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:32.582464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:32.589222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.589668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.590463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:32.590897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:32.739536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:32.748341 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0804d83a-b5da-4a5a-a18f-4a1e230b7562 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.170933 Jul 26 14:56:32.751542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 228/445] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:32 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:33.195910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:33.196542 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:33.203251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.203753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.205135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.205634 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.271335 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:33.279170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c8a81a97-124d-49b6-8212-a442ac0f79af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1139 microversion: 2.1 time: 0.087345 Jul 26 14:56:33.279779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 218/446] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:33 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1139 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:33.569338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:33.569873 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:33.576023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.576490 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.577235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.577666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.715081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:33.723168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-35865077-3326-4fc8-bd05-879e10a23001 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.157825 Jul 26 14:56:33.726887 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 229/447] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:33 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:33.771197 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:33.771849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:33.778067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.779974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.779974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:33.779974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:33.927142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:33.931275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:33.936290 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-89926c80-10cb-4b82-8335-96a59eced705 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1722 microversion: 2.1 time: 0.170007 Jul 26 14:56:33.937183 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 219/448] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:33 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:34.300987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:34.301606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:34.307825 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.308271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:34.309045 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.309484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:34.371238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:34.378950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fdaeda5d-49e7-4a56-be0b-9230065fe603 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1131 microversion: 2.1 time: 0.082355 Jul 26 14:56:34.379669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 230/449] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:34 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1131 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:34.744814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:34.745381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:34.752328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.752779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:34.753543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.753981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:34.880851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:34.888656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-72acb533-7591-4aae-a20c-7cc2830b02a7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.147820 Jul 26 14:56:34.889222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 220/450] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:34 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:34.958662 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:34.959267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:34.965862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.966314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:34.967081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:34.967728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.101028 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:35.109264 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-14312bd0-db26-428d-a7a3-a51663719a72 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1699 microversion: 2.1 time: 0.155058 Jul 26 14:56:35.109829 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 231/451] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:34 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:35.131498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-27751699-e455-4756-9660-ecf1aeaf8871 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:35.137912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-27751699-e455-4756-9660-ecf1aeaf8871 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.138547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-27751699-e455-4756-9660-ecf1aeaf8871 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.202359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-27751699-e455-4756-9660-ecf1aeaf8871 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Going to try to start instance {{(pid=124888) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:56:35.401286 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:35.402220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:35.412520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.413066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.414112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.414734 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.479915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:35.487993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d066156a-480d-4777-8020-e3ae16054dca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1187 microversion: 2.1 time: 0.090797 Jul 26 14:56:35.488567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 232/452] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:35 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:35.852504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-27751699-e455-4756-9660-ecf1aeaf8871 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.725920 Jul 26 14:56:35.854595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 221/453] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:56:35 2022] POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:56:35.872239 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:35.873472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:35.884777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.885584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.886979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.887777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.912223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:35.912921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:35.919734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.920262 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:35.921103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:35.921543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:36.096375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:36.107820 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e9d4a22a-0d98-482b-a11b-dd73bd4f78d4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.248957 Jul 26 14:56:36.108330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 233/454] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:35 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:36.116071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:36.124028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-48f1532f-0009-4d91-b2c4-b7b866646836 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.217338 Jul 26 14:56:36.128774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 222/455] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:35 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:36.509733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:36.510308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:36.516387 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:36.538953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:36.538953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:36.538953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:36.584616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:36.589297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fa456af0-2c47-40ca-b0fe-57d1ce33e2d8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.083580 Jul 26 14:56:36.589868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 234/456] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:36 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:37.129744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:37.130342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:37.136931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.137479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.138245 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.138675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.146874 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:37.147489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:37.153890 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.154345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.155119 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.155586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.271736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:37.279645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-12afd468-6435-46bb-be20-826747310726 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.153871 Jul 26 14:56:37.280321 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 223/457] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:37 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:37.288965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:37.296368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2a76d4d2-3a43-4b50-abb1-50d37da141c1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.154120 Jul 26 14:56:37.296929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 235/458] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:37 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:37.610522 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:37.611130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:37.617270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.617721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.618486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:37.619005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:37.680627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:37.688112 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3f7639d3-c005-48ff-b3f9-463aa3e82177 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.081784 Jul 26 14:56:37.688663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 224/459] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:37 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:38.302500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:38.303110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:38.305602 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:38.310518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.310975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.311782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.312241 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.317959 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:38.318809 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:38.326210 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.329462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.329462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.329462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.457178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:38.465413 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-22bb3976-cd39-4eeb-a7ad-ce3ca9125cf3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.167423 Jul 26 14:56:38.465989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 236/460] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:38 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:38.476407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:38.488374 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-52c78339-32d0-4a73-a2ab-4db780db87a0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.175263 Jul 26 14:56:38.488956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 225/461] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:38 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:38.711317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:38.712273 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:38.718373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.718826 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.719680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:38.720161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:38.805112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:38.812644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c88ccdb9-b4ff-4e08-b2b3-074c2fad3306 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.106722 Jul 26 14:56:38.813238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 237/462] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:38 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:39.492350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:39.493322 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:39.496405 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:39.502314 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.502825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.503709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.504251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.518354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:39.518969 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:39.527912 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.528355 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.529142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.529564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.682842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:39.697867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:39.704294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4c640038-88c5-4759-98ad-ec63e67babc4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.215681 Jul 26 14:56:39.705482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 226/463] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:39 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:39.714263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ff78f45c-ceab-4a0b-abe7-5ce946fde9bb tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.208122 Jul 26 14:56:39.715871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 238/464] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:39 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:39.843585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:39.844227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:39.850352 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.850857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.851654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:39.852083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:39.916570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:39.924784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-dbd2884a-bf98-4300-a67f-5bcd3216812f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.085201 Jul 26 14:56:39.925390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 227/465] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:39 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:40.737253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:40.738189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:40.738854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:40.739876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:40.748491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.749222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.749781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.750470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.750594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.751185 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.752334 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.753051 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.919278 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:40.921141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:40.928777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8d43edee-c609-4592-a809-5aa742e8eea6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.198497 Jul 26 14:56:40.929208 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-60f190c5-a58b-4fdb-97c9-ac2a9a0acdcd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.197355 Jul 26 14:56:40.929387 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 239/466] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:40 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:40.929874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 228/467] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:40 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:40.952670 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:40.953274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:40.959293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.959783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:40.960547 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:40.961083 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.030174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:41.037782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f416e19a-88bf-43d9-b995-df22651f8ab2 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.089189 Jul 26 14:56:41.038365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 240/468] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:40 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:41.950613 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:41.951288 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:41.951819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:41.951968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:41.953160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=4 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:41.953962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=12 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:41.959049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.959467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.959872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.960315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.960467 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.960774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:41.961327 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:41.961960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:42.112741 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:42.120950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a4c06659-f859-495f-afee-3054b61fe73a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.174123 Jul 26 14:56:42.121525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 229/469] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:41 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:42.126036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:42.126772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:42.130475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:42.133200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:42.133738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:42.134585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:42.135121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:42.146623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9b21caec-f78c-4fd6-a61a-a3bcccdb4fe5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.199483 Jul 26 14:56:42.147357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 241/470] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:41 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:42.202231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:42.211727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0b304ae7-5b7a-49a4-a0f8-36f9cc77512b tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1195 microversion: 2.1 time: 0.088969 Jul 26 14:56:42.212552 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 230/471] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:42 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:43.154053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:43.154684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:43.156547 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=8 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.162150 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.162601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.163374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.163921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.172361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:43.173212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:43.179844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.180297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.181256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.181736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.339394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:43.354370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bd9cb589-f768-4d44-8654-ba7df59d2457 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.203788 Jul 26 14:56:43.363600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 242/472] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:43 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:43.369898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:43.370932 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:43.380706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.381371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.382768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:43.383429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:43.473007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:43.479459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:43.486505 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a8fc3de6-5e32-48d5-ada6-30ec9ee4cec8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1205 microversion: 2.1 time: 0.129694 Jul 26 14:56:43.487293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 243/473] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:43 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:43.784031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:43.793108 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6e2c6121-b46d-439c-bcbc-9059ba6ecf9f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.625930 Jul 26 14:56:43.793846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 231/474] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:43 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:44.378361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:44.380911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:44.387811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.390306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.391144 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.393240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.510503 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:44.511251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:44.526025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.526592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.527468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.528063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.621171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:44.633244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-99fd5734-cab7-479e-9724-b16689f828d7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.260049 Jul 26 14:56:44.635164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 244/475] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:44 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:44.811890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:44.817568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:44.818205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:44.825393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.825626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-231ed282-f754-4ad3-8086-77223482e13d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1273 microversion: 2.1 time: 0.319566 Jul 26 14:56:44.825844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.826633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:44.827308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:44.841192 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 232/476] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:44 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:44.973948 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:44.986197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3001c7f8-aada-4b88-9607-4a56bab19a88 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1708 microversion: 2.1 time: 0.172975 Jul 26 14:56:45.000615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 245/477] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:44 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:45.638085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-d9eb4462-effb-428d-828c-2f3e83d7b3d9 req-855ebdc2-39b1-47d4-927f-dc52c4327da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:45.648518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-3dfc2b69-4ed7-4821-bf8f-348f9d0bc068 req-2ed7cc74-b7ac-4237-b3d7-b008b0049376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5646d5b5-6207-4584-bf5b-be1d1c6904c5", "name": "network-vif-plugged", "status": "completed", "tag": "f0eafead-2868-4633-b117-bf601471eb13"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:45.668360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-3dfc2b69-4ed7-4821-bf8f-348f9d0bc068 req-2ed7cc74-b7ac-4237-b3d7-b008b0049376 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.668360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-3dfc2b69-4ed7-4821-bf8f-348f9d0bc068 req-2ed7cc74-b7ac-4237-b3d7-b008b0049376 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.676904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-d9eb4462-effb-428d-828c-2f3e83d7b3d9 req-855ebdc2-39b1-47d4-927f-dc52c4327da6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.677656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-d9eb4462-effb-428d-828c-2f3e83d7b3d9 req-855ebdc2-39b1-47d4-927f-dc52c4327da6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.678367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-3dfc2b69-4ed7-4821-bf8f-348f9d0bc068 req-2ed7cc74-b7ac-4237-b3d7-b008b0049376 service nova] Creating event network-vif-plugged:f0eafead-2868-4633-b117-bf601471eb13 for instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 on hv-cinder-85103 Jul 26 14:56:45.684345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-3dfc2b69-4ed7-4821-bf8f-348f9d0bc068 req-2ed7cc74-b7ac-4237-b3d7-b008b0049376 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039701 Jul 26 14:56:45.685422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 246/478] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:45.691387 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:45.696122 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:45.698971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.699535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.700376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.700883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.701922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-d9eb4462-effb-428d-828c-2f3e83d7b3d9 req-855ebdc2-39b1-47d4-927f-dc52c4327da6 service nova] Creating event network-changed:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 14:56:45.713724 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-d9eb4462-effb-428d-828c-2f3e83d7b3d9 req-855ebdc2-39b1-47d4-927f-dc52c4327da6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078979 Jul 26 14:56:45.714581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 233/479] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:45.852441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:45.853558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:45.863839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.864518 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.865687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:45.866341 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:45.890379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:45.900275 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-52c03089-d5a6-4f85-bc28-d5f983dc1bd5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.213450 Jul 26 14:56:45.903589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 247/480] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:45 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:46.009020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:46.010635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:46.016730 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.017168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:46.018422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.019180 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:46.210166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:46.218482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-de442a6e-2cf9-4b32-8b4a-9b655e153017 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1712 microversion: 2.1 time: 0.213504 Jul 26 14:56:46.219321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 248/481] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:46 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1712 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:46.240606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:46.254966 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-514fcfaf-ee6f-4911-8a4c-f126e8febd94 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.409730 Jul 26 14:56:46.256051 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 234/482] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:45 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:46.921577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:46.922187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:46.928831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.929281 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:46.930049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:46.930484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:47.072359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:47.081556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c009aa3f-4640-4f2d-bbed-c6b29841cca3 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.163817 Jul 26 14:56:47.082132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 249/483] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:46 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:47.279800 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:47.283889 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:47.290393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:47.291199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:47.292298 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:47.292893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:47.457235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:47.465219 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9ea5d0e1-53c6-4727-90cf-2e61a8c42abe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.192440 Jul 26 14:56:47.465801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 235/484] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:47 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:48.104456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:48.105589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:48.113021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.113469 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.114249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.114707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.314439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:48.322271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bec263f6-6aea-4ca7-8655-1d9640598ea0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.223053 Jul 26 14:56:48.322907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 250/485] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:48 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:48.487646 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:48.487646 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:48.494507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.494961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.495783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:48.496224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:48.500501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:56:48.636429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:48.644557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b81990ec-dbbf-470d-a5f6-fe8c3c6f87aa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.161819 Jul 26 14:56:48.645393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 236/486] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:48 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:49.349992 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:49.351259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:49.363770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.364745 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.377278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.378081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.545720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:49.553979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-73e29aef-ece3-417c-b077-41c9ed69b262 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1367 microversion: 2.1 time: 0.212390 Jul 26 14:56:49.554547 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 251/487] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:49 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:49.668526 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:49.669157 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:49.677011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.677455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.678240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:49.678677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:49.814134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:49.821949 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5659620b-45ef-4597-96d5-fcadb4371ca0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.157315 Jul 26 14:56:49.822527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 237/488] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:49 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:50.575306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:50.575899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:50.582776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.583234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.584123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.584621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.725502 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:50.733149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4d4232ec-fb94-4bdc-bbdb-3ed0697cbc48 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1557 microversion: 2.1 time: 0.162085 Jul 26 14:56:50.733715 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 252/489] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:50 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:50.754359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:50.754910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:50.761708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.762209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.762987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.763453 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.843081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:50.843621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:50.851050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-966f12ef-8899-428c-8789-3f5e2ae96e7b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100350 Jul 26 14:56:50.851659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.852116 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.853073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:50.853677 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:50.859941 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 238/490] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:56:50 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:56:51.141744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:51.150769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-20f43a22-da2c-4852-bb65-79d207c752ae tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.311764 Jul 26 14:56:51.151349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 253/491] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:50 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:56:52.173378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:52.175522 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:52.182224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:52.182866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:52.184004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:52.184617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:52.230262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-10eccc03-6fef-4092-84fb-c62cb0ab9743 req-9ab48acd-a67a-4452-ba30-f4c8c7a55d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5646d5b5-6207-4584-bf5b-be1d1c6904c5", "tag": "f0eafead-2868-4633-b117-bf601471eb13"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:56:52.242479 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-10eccc03-6fef-4092-84fb-c62cb0ab9743 req-9ab48acd-a67a-4452-ba30-f4c8c7a55d95 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:52.243225 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-10eccc03-6fef-4092-84fb-c62cb0ab9743 req-9ab48acd-a67a-4452-ba30-f4c8c7a55d95 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:52.255604 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-10eccc03-6fef-4092-84fb-c62cb0ab9743 req-9ab48acd-a67a-4452-ba30-f4c8c7a55d95 service nova] Creating event network-changed:f0eafead-2868-4633-b117-bf601471eb13 for instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 on hv-cinder-85103 Jul 26 14:56:52.260865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-10eccc03-6fef-4092-84fb-c62cb0ab9743 req-9ab48acd-a67a-4452-ba30-f4c8c7a55d95 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034170 Jul 26 14:56:52.261599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 254/492] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:56:52.569712 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:52.578129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-22fbc0ae-7354-40d9-93fa-f1a45ffb7be4 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.409540 Jul 26 14:56:52.578807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 239/493] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:52 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:53.600911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:53.601780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:53.608646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:53.609104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:53.609887 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:53.610326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:53.750910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:53.759073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-58429364-8456-480d-94b6-650fd261e7fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.163283 Jul 26 14:56:53.759686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 255/494] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:53 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:54.781646 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:54.782263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:54.789510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:54.789963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:54.790727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:54.791167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:54.921133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:54.929212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a8bda92d-5bb8-4eab-aab5-f4bfaf76d583 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.151436 Jul 26 14:56:54.929775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 240/495] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:54 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:55.949528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:55.950043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:55.957330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.957777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:55.958538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:55.959002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:56.088463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:56.096595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fdbebd8b-a547-4819-8506-207867b60568 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.150997 Jul 26 14:56:56.097165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 256/496] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:55 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:57.119296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:57.119296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:57.124116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:57.124573 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:57.125341 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:57.125780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:57.257420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:57.264925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0ca36c66-b500-48f6-a17c-cc1cb0210e11 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.151828 Jul 26 14:56:57.265494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 241/497] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:57 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:58.286744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:58.287364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:58.294750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:58.302019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:58.302019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:58.302019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:58.431912 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:58.439781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e65152c4-b394-4e36-9c7d-1dc8e16cefca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.157186 Jul 26 14:56:58.440351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 257/498] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:58 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:56:59.460768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:56:59.461460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:56:59.468053 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:59.468515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:59.469286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:56:59.469745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:56:59.604731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:56:59.612145 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ce8adc9e-6f72-42b1-8ed9-8a1863779083 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.155315 Jul 26 14:56:59.612710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 242/499] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:56:59 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:00.633059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:00.633745 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:00.640353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:00.640815 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:00.641584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:00.642244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:00.774934 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:00.782474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-900902f8-e742-4789-8e61-6bf675112fd8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.153328 Jul 26 14:57:00.783674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 258/500] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:00 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:01.804214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:01.804836 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:01.811364 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:01.811794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:01.812575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:01.813018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:01.944899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:01.956115 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-96f01ffb-d19a-493b-95f7-29a6eb03c2a7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.155842 Jul 26 14:57:01.956690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 243/501] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:01 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:02.717655 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:57:02.718279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 14:57:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:57:02.976731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:02.977346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:02.983825 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:02.984281 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:02.985046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:02.985481 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:03.116707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:03.124109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f48dbff5-8c73-48bd-92ab-9d5db53dc464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.151255 Jul 26 14:57:03.124668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 259/502] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:02 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:04.111784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-cc917b2e-1048-48d6-82e6-e959107f957c req-adf19ff6-6d53-4ce7-bd51-766ceada79c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "name": "network-vif-plugged", "status": "completed", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:04.121897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-cc917b2e-1048-48d6-82e6-e959107f957c req-adf19ff6-6d53-4ce7-bd51-766ceada79c9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:04.122346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-cc917b2e-1048-48d6-82e6-e959107f957c req-adf19ff6-6d53-4ce7-bd51-766ceada79c9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:04.133488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-cc917b2e-1048-48d6-82e6-e959107f957c req-adf19ff6-6d53-4ce7-bd51-766ceada79c9 service nova] Creating event network-vif-plugged:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 14:57:04.138443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-cc917b2e-1048-48d6-82e6-e959107f957c req-adf19ff6-6d53-4ce7-bd51-766ceada79c9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030929 Jul 26 14:57:04.139053 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 244/503] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:04.146040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:04.153726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:04.153977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:04.154432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:04.155213 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:04.155696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:04.289394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:04.297018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c20bf82b-14be-466c-9921-0dbf56ab0448 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.155030 Jul 26 14:57:04.311628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 260/504] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:04 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:05.322643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:05.323395 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:05.330799 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:05.331243 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:05.332037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:05.332475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:05.466759 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:05.475000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7a7445cf-bed1-4562-84ef-a697548d8135 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.157241 Jul 26 14:57:05.475664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 245/505] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:05 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:05.942025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 14:57:05.942200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 14:57:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 14:57:06.496109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:06.496791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:06.503738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:06.504172 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:06.504938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:06.505373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:06.682196 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:06.685647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:06.690505 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-37c571cc-2a4a-48ad-bbd6-cecbbca14ad0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1261 microversion: 2.1 time: 0.198344 Jul 26 14:57:06.691138 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 261/506] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:06 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:07.711679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:07.712292 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:07.718795 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:07.719234 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:07.720643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:07.721086 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:07.851130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:07.858630 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-96705eb8-fed7-46b0-b08c-596f3f999da3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1444 microversion: 2.1 time: 0.150970 Jul 26 14:57:07.859190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 246/507] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:07 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:07.879548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:07.880159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:07.886663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:07.887106 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:07.887898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:07.888336 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:08.016787 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:08.025174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fbdab199-5e51-4c15-8a00-e6eb9402f596 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1444 microversion: 2.1 time: 0.150371 Jul 26 14:57:08.025735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 262/508] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:07 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1444 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:10.538554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-69cfe23c-ac88-4d3f-9d01-a424df380a37 req-7141f547-ec4d-4cbb-99a9-2ea0b10c1a2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:10.544303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=42 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:10.550286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-69cfe23c-ac88-4d3f-9d01-a424df380a37 req-7141f547-ec4d-4cbb-99a9-2ea0b10c1a2f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:10.550730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-69cfe23c-ac88-4d3f-9d01-a424df380a37 req-7141f547-ec4d-4cbb-99a9-2ea0b10c1a2f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:10.565216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-69cfe23c-ac88-4d3f-9d01-a424df380a37 req-7141f547-ec4d-4cbb-99a9-2ea0b10c1a2f service nova] Creating event network-changed:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 14:57:10.570664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-69cfe23c-ac88-4d3f-9d01-a424df380a37 req-7141f547-ec4d-4cbb-99a9-2ea0b10c1a2f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036007 Jul 26 14:57:10.572160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 247/509] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:42.446449 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=53 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.447177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:42.605965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "137ae5a9-b1e1-469c-a127-73f1f56e2b82"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:42.608466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:42.614981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:42.615469 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:42.616244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:42.616687 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:43.406648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cd726e21-9bda-404e-b0fd-1a100e76dc16 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.964735 Jul 26 14:57:43.407962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 263/510] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:57:42 2022] POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:57:52.010976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:57:52.013283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:52.015898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=60 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:57:52.022036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:52.022482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:52.023305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:52.023761 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:52.046180 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'flavor' on Instance uuid b501f137-fb1d-40f6-88c9-646247bebae0 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:57:52.454337 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0c4a2b15-e543-4747-a5e3-cf0cd5bab685 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/action" status: 200 len: 32 microversion: 2.1 time: 0.445702 Jul 26 14:57:52.454963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 248/511] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:57:52 2022] POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/action => generated 32 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:57:52.465645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:52.466345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:52.473261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:52.473738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:52.474521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:52.474960 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:52.615568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:52.623805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ba06ddab-56c8-496d-a6f2-0f58b291388d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.162957 Jul 26 14:57:52.624422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 264/512] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:52 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:53.647592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:53.648313 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:53.654514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:53.654967 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:53.656104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:53.656198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:53.786312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:53.794296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-efa997c7-0dfa-4cf1-8f8f-3d0b1eff7f3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.151698 Jul 26 14:57:53.794858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 249/513] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:53 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:54.816484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:54.817025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:54.823540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:54.823992 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:54.824757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:54.825197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:54.951027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:54.960050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d5461986-6696-4f43-a9d1-772caa8fb2d0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.148062 Jul 26 14:57:54.960654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 265/514] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:54 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:55.981129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:55.981730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:55.989011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:55.989452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:55.990207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:55.990643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:56.121424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:56.131037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c1846cee-ce0e-4dc7-b616-71a3fe094912 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.153804 Jul 26 14:57:56.131647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 250/515] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:55 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:57.151976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:57.152585 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:57.159040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:57.159521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:57.160302 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:57.160737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:57.287723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:57.295615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ff28b462-fe31-40ff-bd41-44830182b268 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.147475 Jul 26 14:57:57.296179 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 266/516] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:57 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:58.320002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:58.320514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:58.326990 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:58.327475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:58.328242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:58.328679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:58.456648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:58.464797 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3b76368d-7845-408b-a6ed-0b6871886a08 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.148808 Jul 26 14:57:58.465368 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 251/517] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:58 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:57:59.487460 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:57:59.488017 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:57:59.494551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:59.495005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:59.495805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:57:59.496246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:57:59.630360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:57:59.638351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-98bbb6e9-b58c-4065-bf73-863379b712c6 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.155508 Jul 26 14:57:59.638922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 267/518] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:57:59 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:00.660322 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:00.660975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:00.667488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:00.667936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:00.668714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:00.669170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:00.796719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:00.804772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ebf64b21-eb46-4012-bafa-70ecfe51a81e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.148976 Jul 26 14:58:00.805342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 252/519] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:00 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:01.826108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:01.826724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:01.833325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:01.833783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:01.834555 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:01.834999 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:01.963754 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:01.973721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5ccb2bdc-ad98-494b-bccf-434c6185f978 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.151165 Jul 26 14:58:01.974751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 268/520] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:01 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:02.845192 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:02.845707 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:02.852056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:02.852505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:02.853812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:02.854341 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:02.980827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'services' on Instance uuid d1552ebb-d614-4398-96ba-47e3fd737e3d {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:58:02.995827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:02.996436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:03.003049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:03.003531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:03.004302 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:03.004737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:03.139778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:03.148714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-16754b7c-e3c6-49d8-95b2-d2a100dbe312 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.156691 Jul 26 14:58:03.149323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 269/521] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:02 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:03.288245 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0481fc77-44d9-4056-9abc-6cb5af21daf9 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments/2ca5f48a-b79d-45ce-b0a1-5b41aa11810d" status: 202 len: 0 microversion: 2.1 time: 0.553112 Jul 26 14:58:03.288909 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 253/522] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 14:58:02 2022] DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments/2ca5f48a-b79d-45ce-b0a1-5b41aa11810d => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:04.170217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:04.170858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:04.177469 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:04.177919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:04.178680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:04.179116 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:04.323822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:04.333154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-091f12df-8f5b-4ce1-ad32-1e0b144d7b07 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.166910 Jul 26 14:58:04.333714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 270/523] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:04 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:05.356187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:05.356832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:05.364089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:05.364535 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:05.365319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:05.365750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:05.464880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bac3246b-c6a5-46fb-a40a-3073b0209dc3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:05.471961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bac3246b-c6a5-46fb-a40a-3073b0209dc3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:05.472416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bac3246b-c6a5-46fb-a40a-3073b0209dc3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:05.494744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bac3246b-c6a5-46fb-a40a-3073b0209dc3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Going to try to stop instance {{(pid=124889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 14:58:05.495293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:05.503547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7e985b25-61fb-4238-9f5f-5b0ebfd90688 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.152062 Jul 26 14:58:05.504181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 254/524] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:05 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:05.720492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bac3246b-c6a5-46fb-a40a-3073b0209dc3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.258526 Jul 26 14:58:05.721015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 271/525] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:58:05 2022] POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:58:05.729594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:05.730199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:05.736409 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:05.736857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:05.737638 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:05.738066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:05.870360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:05.877995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7d397d76-f60f-4b00-b315-2d811ab6d1f6 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.152311 Jul 26 14:58:05.878555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 255/526] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:05 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:06.527147 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:06.527996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:06.534857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:06.535304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:06.536112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:06.536574 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:06.664435 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:06.672895 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6adfce4c-e79f-49f7-8e7c-e05468aca3b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.150365 Jul 26 14:58:06.673447 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 272/527] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:06 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:06.899836 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:06.900368 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:06.906880 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:06.907330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:06.908132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:06.908570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:07.049822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:07.057707 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0ce1e7c2-af07-467f-85dd-3d52697aebbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.162038 Jul 26 14:58:07.062338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 256/528] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:06 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:07.694426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:07.695046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:07.701606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:07.702064 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:07.702833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:07.703275 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:07.846874 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:07.854804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d27599fe-d721-4f61-88df-841b441bb4ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.164237 Jul 26 14:58:07.855368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 273/529] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:07 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:08.080304 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:08.080917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:08.087343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:08.087831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:08.088599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:08.089038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:08.217554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:08.225259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1e471d3c-4673-4261-ba93-a7bfd5dd1568 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.149410 Jul 26 14:58:08.225827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 257/530] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:08 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:08.875982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:08.876515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:08.882956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:08.883430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:08.884238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:08.884677 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:09.014133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:09.022989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ddec7375-75d0-4a26-8ca4-0a81fc1047ed tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.151079 Jul 26 14:58:09.023582 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 274/531] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:08 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:09.246226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:09.246770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:09.253885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:09.254339 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:09.255119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:09.255611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:09.401000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:09.401000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-249ec521-3755-4c67-9b57-16b733c031d1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.157737 Jul 26 14:58:09.401000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 258/532] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:09 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:10.044378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:10.044993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:10.051643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:10.052087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:10.052867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:10.053309 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:10.184729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:10.193281 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2671f39a-2d57-4b17-b705-753e013116c2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.152860 Jul 26 14:58:10.193855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 275/533] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:10 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:10.421133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:10.421670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:10.428218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:10.428670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:10.429433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:10.429870 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:10.557138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:10.565064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-312c5052-dd66-4a47-91c3-2de5ad2f21e2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.147871 Jul 26 14:58:10.565617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 259/534] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:10 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:11.216679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:11.217351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:11.224498 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:11.224980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:11.225750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:11.226176 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:11.355446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:11.364019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2655ce6d-e6d8-43f6-ac8d-427dd1b66dc5 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.151248 Jul 26 14:58:11.364587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 276/535] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:11 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:11.586309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:11.586851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:11.593295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:11.593745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:11.594515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:11.594949 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:11.731544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:11.739723 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-38707a14-3298-438d-abf9-aec9533898c2 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.157402 Jul 26 14:58:11.740294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 260/536] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:11 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:12.385621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:12.386180 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:12.394181 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:12.394629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:12.395392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:12.395852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:12.400123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:12.527990 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:12.536824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-326c241d-6f5d-4f91-ae7d-ee22690e5926 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.155243 Jul 26 14:58:12.537396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 277/537] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:12 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:12.761498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:12.762014 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:12.768551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:12.768996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:12.769781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:12.770208 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:12.904479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:12.908242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:12.912744 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0ea06f0b-562c-4b9b-8d53-28610d263f13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.155259 Jul 26 14:58:12.913328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 261/538] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:12 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:13.558492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:13.559058 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:13.561504 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=31 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:13.566619 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:13.567108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:13.568207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:13.568678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:13.716261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:13.724643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5434433e-4525-4a67-9087-68c9ac066551 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.170055 Jul 26 14:58:13.725216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 278/539] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:13 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:13.938952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:13.939490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:13.946687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:13.947136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:13.947937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:13.948373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:14.079736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:14.087234 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6b075faf-1d39-45f9-ac97-0ceaf84abd65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.152926 Jul 26 14:58:14.087833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 262/540] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:13 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:14.746109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:14.746756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:14.753471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:14.753924 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:14.754694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:14.755136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:14.884932 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:14.893491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4c0692a4-2d1a-491e-a157-1ac0c160c56f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.151332 Jul 26 14:58:14.894000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 279/541] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:14 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:15.109012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.109541 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:15.116723 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:15.117176 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:15.117947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:15.118386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:15.251026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:15.258565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5d20f6b6-df6b-4fce-9ce3-930bb366153c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.153565 Jul 26 14:58:15.259366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 263/542] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:15.915608 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:15.916250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:15.923020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:15.923507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:15.924289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:15.924728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:16.069481 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:16.086795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c14e9996-c773-48e0-abdf-579037476cb7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.174922 Jul 26 14:58:16.087388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 280/543] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:15 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:16.281023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:16.281650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:16.288930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:16.289374 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:16.290148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:16.290573 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:16.425786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:16.433330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2242f20f-a1bf-4819-bd5d-b2efa29ad18c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.156163 Jul 26 14:58:16.433893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 264/544] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:16 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:17.111325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:17.112444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:17.121405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:17.121856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:17.122623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:17.123060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:17.264373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:17.275048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-74de5655-8fe2-4258-8137-195e6bb0577d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1736 microversion: 2.1 time: 0.168006 Jul 26 14:58:17.276088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 281/545] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:17 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:17.456197 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:17.462675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:17.472032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:17.472563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:17.473355 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:17.473791 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:17.619803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:17.627915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a2194fab-f888-4296-b776-e82ff74ca71d tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.176757 Jul 26 14:58:17.628481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 265/546] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:17 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:18.301973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:18.302749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:18.311436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.311962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.312667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.313852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.470218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:18.478595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-faee1946-147e-47eb-a04a-3b1d535922b0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1716 microversion: 2.1 time: 0.182403 Jul 26 14:58:18.479163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 282/547] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:18 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1716 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:18.540527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:18.541028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:18.548336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.552734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.552734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.552734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.645168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] HTTP exception thrown: Cannot 'detach_volume' instance b501f137-fb1d-40f6-88c9-646247bebae0 while it is in vm_state rescued Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Request method failure captured: Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments/137ae5a9-b1e1-469c-a127-73f1f56e2b82 HTTP/1.1 Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-PIfzinAT7j3dv57JccSfrAoVCFVjPpG63tDdFDSnC52c_acC3y6ADqFz9G26qAkZXun6SvpAH2C0ZO-InmiQ04DNJOkLRJcpJbyyIHtF_ueuNI8AIzuWIkxAkgONA_gAYkJcQ9wt_v4sz0kFRjBzbyQ60U6zhA0LHE3brfHBo5ss Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:58:18.646886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4f3f79533bbf48018798e6e65050d69c"}]}] Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 19c0408b4321495eabd4738bbb8b711b Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:58:18.648719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Cannot 'detach_volume' instance b501f137-fb1d-40f6-88c9-646247bebae0 while it is in vm_state rescued Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'server_id': 'b501f137-fb1d-40f6-88c9-646247bebae0', 'id': '137ae5a9-b1e1-469c-a127-73f1f56e2b82'} Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b501f137-fb1d-40f6-88c9-646247bebae0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:58:18.649896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b501f137-fb1d-40f6-88c9-646247bebae0 while it is in vm_state rescued Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b501f137-fb1d-40f6-88c9-646247bebae0 while it is in vm_state rescued Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:18.651136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Returning 409 to user: Cannot 'detach_volume' instance b501f137-fb1d-40f6-88c9-646247bebae0 while it is in vm_state rescued {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:58:18.652134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-058ab721-f8f2-4011-bc41-7ade5d14b6b7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments/137ae5a9-b1e1-469c-a127-73f1f56e2b82" status: 409 len: 152 microversion: 2.1 time: 0.112092 Jul 26 14:58:18.652134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 266/548] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 14:58:18 2022] DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments/137ae5a9-b1e1-469c-a127-73f1f56e2b82 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 26 14:58:18.652304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:18.652633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:18.661463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.662057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:18.662276 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.663126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:18.663284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.663637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.671382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.695093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.695093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:18.695093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:18.808191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:18.815837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3848a065-9c01-4d88-b9b4-3df6c0695b28 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.169627 Jul 26 14:58:18.816403 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 283/549] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:18 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:19.452176 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-732473af-cd12-442d-9f0a-6408ad197870 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/action" status: 202 len: 0 microversion: 2.1 time: 0.797855 Jul 26 14:58:19.452835 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 267/550] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:58:18 2022] POST /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:58:19.463393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:19.471989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:19.471989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:19.471989 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:19.472410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:19.472843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:19.616354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:19.628226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8e7d59a3-7069-47a9-95c8-13a74262730d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1724 microversion: 2.1 time: 0.169420 Jul 26 14:58:19.629020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 284/551] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:19 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:19.839244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:19.839998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:19.846972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:19.847447 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:19.848234 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:19.848836 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:20.061995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:20.071712 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-47f14fb6-6419-4223-b8db-94561db51377 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.237154 Jul 26 14:58:20.072291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 268/552] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:19 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:20.652788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:20.653532 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:20.662441 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:20.663149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:20.664338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:20.664808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:20.818423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:20.827710 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-39494334-4f59-4378-9a7c-1134a0e6a21f tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1724 microversion: 2.1 time: 0.178627 Jul 26 14:58:20.828808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 285/553] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:20 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:21.093577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:21.094803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:21.101084 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:21.101538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:21.102447 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:21.102957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:21.245341 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:21.253309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ee4e0906-ba22-4fdd-a5ee-0f94d2f5f5ee tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.163925 Jul 26 14:58:21.253876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 269/554] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:21 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:21.853889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:21.854506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:21.861681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:21.862137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:21.862919 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:21.863356 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.011137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:22.022437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7d5770d8-be53-4902-844a-aefadc160fc9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1724 microversion: 2.1 time: 0.172124 Jul 26 14:58:22.023025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 286/555] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:21 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:22.252832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:22.253388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:22.255363 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=46 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:22.261660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.268607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.268607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.268607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.274746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:22.275360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:22.282319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.282624 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.283429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.283871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.289864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-13e67b75-4685-4e26-b013-274563d48a11 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/ips" status: 200 len: 149 microversion: 2.1 time: 0.158135 Jul 26 14:58:22.291946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 270/556] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 14:58:22 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/ips => generated 149 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:22.304279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc875573-aa33-4981-8d82-98b3ecd84ee1"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:22.306747 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:22.313490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.313941 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.314803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.315245 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.404121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: POST /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/os-volume_attachments HTTP/1.1 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 74 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:58:22.405664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {"volumeAttachment": {"volumeId": "dc875573-aa33-4981-8d82-98b3ecd84ee1"}} Jul 26 14:58:22.407810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'server_id': '5646d5b5-6207-4584-bf5b-be1d1c6904c5', 'body': {'volumeAttachment': {'volumeId': 'dc875573-aa33-4981-8d82-98b3ecd84ee1'}}} Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:22.408833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:22.409970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 400 to user: Invalid volume: volume dc875573-aa33-4981-8d82-98b3ecd84ee1 is already attached to instances: 7c808f60-6b5e-4ad9-8463-47c749c4ad58 {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bb24aaec-d188-4b91-b0cf-d3393e54d409 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107828 Jul 26 14:58:22.411392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 271/557] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 14:58:22 2022] POST /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 14:58:22.419941 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:22.419941 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:22.424320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.424777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.425618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.426008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.434964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:22.442805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9f378e88-fc9a-479a-838c-fe36668c36d8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1676 microversion: 2.1 time: 0.172172 Jul 26 14:58:22.443368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 287/558] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:22 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:22.450765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:58:22.843916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a13103b4-09c9-4d58-8c79-c4f3828211ad tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 204 len: 0 microversion: 2.1 time: 0.430510 Jul 26 14:58:22.844547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 272/559] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:58:22 2022] DELETE /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:58:22.852868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:22.853500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:22.860465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.861074 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:22.861671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:22.862107 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.001245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:23.008796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d79ca194-fbcd-4ccd-adb9-de2f8e9b9990 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1681 microversion: 2.1 time: 0.160011 Jul 26 14:58:23.009362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 288/560] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:22 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:23.045249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:23.045952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:23.054564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.054770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.055595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.056043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.186335 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:23.194389 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a5093d72-aa5e-4c50-b48e-0c0906b4082c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1724 microversion: 2.1 time: 0.153289 Jul 26 14:58:23.194988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 273/561] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:23 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:23.464831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:23.465441 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:23.471609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.472060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.472911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.473349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.605780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:23.614322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a1d7961f-1f19-4a1e-b680-0a7977a01f46 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1653 microversion: 2.1 time: 0.153685 Jul 26 14:58:23.614897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 289/562] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:23 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:23.636087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a24cfb24-6f40-408c-a0b1-83ed30ad9647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:23.642333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a24cfb24-6f40-408c-a0b1-83ed30ad9647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.642783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a24cfb24-6f40-408c-a0b1-83ed30ad9647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.664456 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a24cfb24-6f40-408c-a0b1-83ed30ad9647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Going to try to start instance {{(pid=124888) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 14:58:23.868499 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a24cfb24-6f40-408c-a0b1-83ed30ad9647 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action" status: 202 len: 0 microversion: 2.1 time: 0.236149 Jul 26 14:58:23.869134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 274/563] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:58:23 2022] POST /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:23.877248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:23.877853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:23.884368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.884816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:23.885568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:23.886049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.018088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:24.025899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b950112b-60e0-4a5b-bcf5-d486d135bb07 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1662 microversion: 2.1 time: 0.152463 Jul 26 14:58:24.026474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 290/564] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:23 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:24.033739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:24.034542 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:24.041227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.050994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.050994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.050994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.050994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:24.178513 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:24.187384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e1010611-5d5e-4015-a248-0ae2a100e17d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1681 microversion: 2.1 time: 0.158442 Jul 26 14:58:24.188609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 275/565] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:24 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:24.216297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:24.216906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:24.223811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.224266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.225034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.225473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.360956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:24.369049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4266a3dd-d621-40e7-b8fb-05238f1ffda4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1730 microversion: 2.1 time: 0.156822 Jul 26 14:58:24.369614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 291/566] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:24 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:24.389731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:24.390311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:24.397831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.398279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.399052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:24.399543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:24.482442 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-aa4b7975-a216-45df-9b42-7e646800601e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096836 Jul 26 14:58:24.483031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 276/567] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:58:24 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:25.056691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:25.057322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:25.064258 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:25.064977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:25.065768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:25.066216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:25.212936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:25.212936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:25.215386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:25.221239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:25.221239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:25.221239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:25.221625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:25.224252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cb2a64f4-8157-4b72-8af4-0ae3c562fdf1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1662 microversion: 2.1 time: 0.180256 Jul 26 14:58:25.228438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 292/568] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:25 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1662 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:25.657421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:25.665081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8f80ab5f-f5b3-4901-823f-b3bb3bd38cdc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1681 microversion: 2.1 time: 0.459253 Jul 26 14:58:25.665655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 277/569] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:25 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1681 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:26.246306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:26.246900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:26.254093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:26.254558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:26.255332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:26.255836 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:26.389723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:26.395538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:26.399013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b2777940-9c78-4e90-8229-12f4b287ce13 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1662 microversion: 2.1 time: 0.156714 Jul 26 14:58:26.399633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 293/570] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:26 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:26.687116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:26.688535 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:26.695220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:26.695706 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:26.696493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:26.696938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:26.914446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-0b3f2308-4e61-4710-9817-2e7afadfa6c0 req-fa941e88-b041-4b35-8887-650ebb74bd19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:26.925860 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0b3f2308-4e61-4710-9817-2e7afadfa6c0 req-fa941e88-b041-4b35-8887-650ebb74bd19 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:26.930482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0b3f2308-4e61-4710-9817-2e7afadfa6c0 req-fa941e88-b041-4b35-8887-650ebb74bd19 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:26.938516 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-0b3f2308-4e61-4710-9817-2e7afadfa6c0 req-fa941e88-b041-4b35-8887-650ebb74bd19 service nova] Creating event network-changed:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:58:26.943962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-0b3f2308-4e61-4710-9817-2e7afadfa6c0 req-fa941e88-b041-4b35-8887-650ebb74bd19 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110656 Jul 26 14:58:26.944842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 294/571] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:58:26.978575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:26.987338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-26849cd8-2be0-4bef-b3cf-bf6a5de1d2e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1681 microversion: 2.1 time: 0.304243 Jul 26 14:58:26.987964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 278/572] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:26 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:27.425197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:27.425914 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:27.433339 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:27.434076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:27.435046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:27.435674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:27.609062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:27.617364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c3d52149-3381-43fa-89c0-d5c9769a6e50 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1662 microversion: 2.1 time: 0.200261 Jul 26 14:58:27.631258 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 295/573] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:27 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1662 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:28.012051 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:28.014026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:28.022801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:28.023678 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:28.024746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:28.025610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:28.135959 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:28.146054 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8b562180-d89c-4145-88cf-dc960f582735 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 200 len: 1613 microversion: 2.1 time: 0.141028 Jul 26 14:58:28.147227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 279/574] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:28 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 1613 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:28.639027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:28.639670 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:28.647830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:28.648296 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:28.649376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:28.649997 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:28.811707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:28.820274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-70ca9f51-6de5-4c40-8311-e40b7b2e58e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1666 microversion: 2.1 time: 0.184958 Jul 26 14:58:28.820862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 296/575] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:28 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1666 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:28.961604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}, {"server_uuid": "5646d5b5-6207-4584-bf5b-be1d1c6904c5", "name": "network-vif-deleted", "tag": "f0eafead-2868-4633-b117-bf601471eb13"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:28.972571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:28.979017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:28.988011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] Creating event network-changed:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:58:28.988738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] Creating event network-vif-deleted:f0eafead-2868-4633-b117-bf601471eb13 for instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 on hv-cinder-85103 Jul 26 14:58:28.996181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-f63dcf17-ec9c-422b-b0a5-0a3562f60fa5 req-0e8f5a27-bb9b-4da9-9e9b-3fcffb24f31b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038643 Jul 26 14:58:28.996781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 280/576] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:29.168282 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:29.168818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:29.175314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:29.175812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:29.176589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:29.177032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:29.191616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 HTTP/1.1 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:58:29.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 14:58:29.195021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '5646d5b5-6207-4584-bf5b-be1d1c6904c5'} Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:58:29.196491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 14:58:29.198637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:29.200444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:58:29.200444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9c23f352-3487-4b50-84be-feee48321035 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 404 len: 111 microversion: 2.1 time: 0.030404 Jul 26 14:58:29.200444 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 297/577] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:29 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:58:29.211145 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-40c6dde9-4792-43f2-87b7-e40ee9450f19 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '.version_select at 0x7f97e62c14c0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:29.358175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-40c6dde9-4792-43f2-87b7-e40ee9450f19 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615510651" status: 202 len: 0 microversion: 2.1 time: 0.151714 Jul 26 14:58:29.358774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 281/578] 10.222.0.97 () {58 vars in 1221 bytes} [Tue Jul 26 14:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615510651 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:30.202432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:30.202917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:30.209578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:30.210024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:30.210848 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:30.211314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:30.336431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lazy-loading 'services' on Instance uuid 7c808f60-6b5e-4ad9-8463-47c749c4ad58 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:58:30.631032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0336d26c-6897-43c0-b8c8-757829d124ea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments/dc875573-aa33-4981-8d82-98b3ecd84ee1" status: 202 len: 0 microversion: 2.1 time: 0.432287 Jul 26 14:58:30.631617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 298/579] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 14:58:30 2022] DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments/dc875573-aa33-4981-8d82-98b3ecd84ee1 => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:30.640784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:30.643108 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:30.650589 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:30.651038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:30.651842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:30.652282 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:30.681351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2fd42f98-03de-4d7d-9952-5685de6b29a1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Jul 26 14:58:30.681906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 282/580] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:58:30 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:31.694268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:31.696711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:31.703488 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:31.703946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:31.704714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:31.705155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:31.734237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8028b947-9a2f-4902-9653-ea6d59096fed tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044854 Jul 26 14:58:31.735390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 299/581] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:58:31 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:32.747483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:32.749590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:32.756559 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:32.757002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:32.757821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:32.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:32.789141 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e90f12d8-db63-475f-bf9d-387ede70f342 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045569 Jul 26 14:58:32.789614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 283/582] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:58:32 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:58:32.856633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:32.857207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:32.863650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:32.864108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:32.864873 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:32.865310 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:32.890222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:58:33.197130 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-391bac0d-56d8-4b75-a9e0-97c4fb5e288d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 204 len: 0 microversion: 2.1 time: 0.344009 Jul 26 14:58:33.197738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 300/583] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:58:32 2022] DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:58:33.206937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:33.209730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:33.213987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:33.214460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:33.215365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:33.215863 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:33.360454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:33.368504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ffeb3a3e-0a8a-446d-9fac-0788e4cc4361 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1681 microversion: 2.1 time: 0.166030 Jul 26 14:58:33.369091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 284/584] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:33 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:34.392512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:34.393210 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:34.400194 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:34.400646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:34.401414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:34.401854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:34.539117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:34.547050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b4f6f58a-99a6-476e-a6ca-160d4b8ad7f6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1681 microversion: 2.1 time: 0.159199 Jul 26 14:58:34.547666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 301/585] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:34 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:35.284686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-c766067f-97b2-4252-b335-d053e0b8b03a req-2666df3d-170d-4c49-beff-e19cdb26477d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c808f60-6b5e-4ad9-8463-47c749c4ad58", "name": "network-vif-deleted", "tag": "73723af2-05ec-4b78-b99d-0201637337f6"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:35.295239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-c766067f-97b2-4252-b335-d053e0b8b03a req-2666df3d-170d-4c49-beff-e19cdb26477d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:35.300800 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-c766067f-97b2-4252-b335-d053e0b8b03a req-2666df3d-170d-4c49-beff-e19cdb26477d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:35.306780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-c766067f-97b2-4252-b335-d053e0b8b03a req-2666df3d-170d-4c49-beff-e19cdb26477d service nova] Creating event network-vif-deleted:73723af2-05ec-4b78-b99d-0201637337f6 for instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 on hv-cinder-85103 Jul 26 14:58:35.311719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-c766067f-97b2-4252-b335-d053e0b8b03a req-2666df3d-170d-4c49-beff-e19cdb26477d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030993 Jul 26 14:58:35.312326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 285/586] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:35.569028 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:35.574474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:35.576416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:35.576872 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:35.577641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:35.578596 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:35.641903 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:35.650012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-32c0ccc1-4728-4ab9-860a-3b30b2fa0bd6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1327 microversion: 2.1 time: 0.085065 Jul 26 14:58:35.650575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 302/587] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:35 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1327 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:36.673348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:36.674046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:36.680561 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:36.681042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:36.681867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:36.682384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:36.714239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:36.714879 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:36.715378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lazy-loading 'fault' on Instance uuid 7c808f60-6b5e-4ad9-8463-47c749c4ad58 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:58:36.760498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:36.767896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4355ab90-5606-4591-b3b4-c12773a851f8 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 200 len: 1332 microversion: 2.1 time: 0.100192 Jul 26 14:58:36.768471 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 286/588] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:36 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:37.789937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:37.790567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:37.797207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:37.797647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:37.798400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:37.798828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:37.812309 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 HTTP/1.1 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:58:37.814428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 14:58:37.815896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '7c808f60-6b5e-4ad9-8463-47c749c4ad58'} Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:58:37.816850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 14:58:37.818245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:37.819621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:58:37.819621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-16c88361-0d1d-424c-979d-4e6c2c137807 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 404 len: 111 microversion: 2.1 time: 0.029998 Jul 26 14:58:37.819621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 303/589] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:37 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:58:37.824694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cb672ac3-02dd-41d2-b2ff-901c56236020 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '.version_select at 0x7f97e62c1dc0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:37.929087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cb672ac3-02dd-41d2-b2ff-901c56236020 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040899823" status: 202 len: 0 microversion: 2.1 time: 0.108116 Jul 26 14:58:37.929656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 287/590] 10.222.0.97 () {58 vars in 1221 bytes} [Tue Jul 26 14:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040899823 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:38.834410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e0baa27b-ddb1-49c6-a62b-3d2372f5b5e0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: .version_select at 0x7f97e630dee0>, body: {"keypair": {"name": "tempest-keypair-1476160910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfySfprNJE2Qr1cxidklN/AMnnLo7Fsfu2zwkKr2n1A+xQenyek4kC6VoTEtNH6MoohsHi7TyqVaP8z9lroJktrRx1vmBf1QFRi23b4s/d0OvbGDeUvrbE0KiMgw93VrQ=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:38.850090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-e0baa27b-ddb1-49c6-a62b-3d2372f5b5e0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:58:38.854091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-e0baa27b-ddb1-49c6-a62b-3d2372f5b5e0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:58:38.963695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e0baa27b-ddb1-49c6-a62b-3d2372f5b5e0 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132943 Jul 26 14:58:38.964221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 304/591] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:58:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:41.459981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1660371883", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0"}], "security_groups": [{"name": "tempest-securitygroup--407407181"}], "key_name": "tempest-keypair-1476160910", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:41.560889 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] validate_networks() for [('4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:58:41.969259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:58:41.969676 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:58:41.970143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:58:41.970569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:58:41.970972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:58:41.980096 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:41.980540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:41.981330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:41.981761 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:41.997848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:58:42.002298 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:58:42.013028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:58:42.015279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:58:42.170546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-33688bdd-4cec-4abe-b7b3-e3df678ef006 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.715528 Jul 26 14:58:42.171189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 288/592] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:58:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:58:42.182002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a1cd8ec9-054a-4d6e-b2ca-b8d317585770 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:42.182706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a1cd8ec9-054a-4d6e-b2ca-b8d317585770 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:42.242795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a1cd8ec9-054a-4d6e-b2ca-b8d317585770 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:42.249529 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a1cd8ec9-054a-4d6e-b2ca-b8d317585770 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1242 microversion: 2.1 time: 0.071327 Jul 26 14:58:42.252966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 305/593] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:42 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:43.273438 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:43.274047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:43.280732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:43.281856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:43.282632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:43.283077 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:43.343919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:43.351286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e4267d74-83aa-49a4-9de3-a2fa6fe5fb1d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1246 microversion: 2.1 time: 0.082490 Jul 26 14:58:43.354686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 289/594] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:43 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:44.373418 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:44.373958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:44.377005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:44.382113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:44.382596 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:44.383388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:44.383856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:44.446492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:44.454991 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f79da879-cfb1-4957-9c16-958a947a8d97 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1302 microversion: 2.1 time: 0.085510 Jul 26 14:58:44.455601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 306/595] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:44 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1302 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:45.476282 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:45.476897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:45.483752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:45.484717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:45.485506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:45.485942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:45.707884 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:45.715223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cf7dc15e-2ae2-4a47-8641-55e16537c501 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.242979 Jul 26 14:58:45.715811 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 290/596] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:45 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:46.092922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:46.095436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:46.102649 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:46.103191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.104072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:46.104512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.197303 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2a25d7e5-2994-419e-8bf7-d8342311b4e2 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "POST /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb/action" status: 200 len: 14 microversion: 2.1 time: 0.108555 Jul 26 14:58:46.197962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 307/597] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:58:46 2022] POST /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:58:46.737832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:46.738427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:46.745000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:46.745456 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.746239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:46.746682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.785920 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-8723bb7c-8073-4cfd-89f1-113be7dc8633 req-05d34c06-d6ca-428f-9c1c-7b7042013c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b3ca784-f197-4dfa-8592-742a8cb0b832", "tag": "9b0e3837-4947-4f14-b8b9-6a4f6f25c7be"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:46.798278 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-8723bb7c-8073-4cfd-89f1-113be7dc8633 req-05d34c06-d6ca-428f-9c1c-7b7042013c28 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:46.798602 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-8723bb7c-8073-4cfd-89f1-113be7dc8633 req-05d34c06-d6ca-428f-9c1c-7b7042013c28 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:46.816471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-8723bb7c-8073-4cfd-89f1-113be7dc8633 req-05d34c06-d6ca-428f-9c1c-7b7042013c28 service nova] Creating event network-changed:9b0e3837-4947-4f14-b8b9-6a4f6f25c7be for instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 on hv-cinder-85103 Jul 26 14:58:46.822345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-8723bb7c-8073-4cfd-89f1-113be7dc8633 req-05d34c06-d6ca-428f-9c1c-7b7042013c28 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040582 Jul 26 14:58:46.823168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 308/598] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:58:46.964685 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:46.973033 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-133772c3-e304-4c09-bd17-f044d36bd911 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.240129 Jul 26 14:58:46.973619 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 291/599] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:46 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:47.698966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:47.699565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:47.707867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:47.708607 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:47.709591 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:47.710165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:47.735626 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:58:47.994767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:47.997687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:48.004856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.018427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.019913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.020380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.105853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-97fa9c74-cad6-4d70-8456-d86ac5c61e6e tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "DELETE /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 204 len: 0 microversion: 2.1 time: 0.518921 Jul 26 14:58:48.106618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 309/600] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:58:47 2022] DELETE /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:58:48.115977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:48.118645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:48.126880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.127654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.128449 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.128904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.247127 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:48.255683 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c60e1fb8-097f-4d5e-a128-685aa63827e5 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.265139 Jul 26 14:58:48.256546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 292/601] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:47 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:48.269449 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:48.277666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-948305df-b998-4073-915a-37eec3e01e9a tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1577 microversion: 2.1 time: 0.165954 Jul 26 14:58:48.278244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 310/602] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:48 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:48.847819 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-f204e81d-3d74-4cad-bb55-8d20d836acbb req-b5f875c5-7046-4d27-90e9-47faab9de5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171f8b78-1bb9-4ab8-9e8e-78aaf0208adb", "tag": "5dc5b800-3fb7-4da8-865c-4676b8e74a36"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:48.857237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f204e81d-3d74-4cad-bb55-8d20d836acbb req-b5f875c5-7046-4d27-90e9-47faab9de5b7 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:48.857704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f204e81d-3d74-4cad-bb55-8d20d836acbb req-b5f875c5-7046-4d27-90e9-47faab9de5b7 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:48.868349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-f204e81d-3d74-4cad-bb55-8d20d836acbb req-b5f875c5-7046-4d27-90e9-47faab9de5b7 service nova] Creating event network-changed:5dc5b800-3fb7-4da8-865c-4676b8e74a36 for instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb on hv-cinder-85103 Jul 26 14:58:48.873308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-f204e81d-3d74-4cad-bb55-8d20d836acbb req-b5f875c5-7046-4d27-90e9-47faab9de5b7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029214 Jul 26 14:58:48.873871 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 293/603] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:49.277263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:49.277866 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:49.284992 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.285452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.286235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.286665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.299769 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:49.300458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:49.305589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:49.306622 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.307067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.307858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:49.308290 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:49.422765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:49.430396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-286abe3d-2aee-47bd-8b4d-421016bc5c34 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.157030 Jul 26 14:58:49.430971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 311/604] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:49 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:49.462177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:49.470607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-717660e4-7139-4363-9de3-90ce94374718 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1577 microversion: 2.1 time: 0.175475 Jul 26 14:58:49.483754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 294/605] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:49 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:50.451114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:50.451665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:50.458786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.459228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.460066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.460504 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.493780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:50.494531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:50.501880 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.502421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.503272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:50.503845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:50.599928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:50.607731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-85ee6daf-df44-464c-b6de-84cd533ffe4f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.160459 Jul 26 14:58:50.608318 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 312/606] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:50 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:50.639111 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:50.646918 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d753ea40-ebae-4400-b5a3-9f3922e798a1 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1577 microversion: 2.1 time: 0.158274 Jul 26 14:58:50.647514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 295/607] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:50 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:51.629177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:51.629787 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:51.636400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.636842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:51.637645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.638084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:51.669057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:51.670452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:51.676654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.677110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:51.677883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:51.678332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:51.696873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:51.776768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:51.784909 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fcf77ac0-0dc9-4077-88fc-69df51027e6f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.159603 Jul 26 14:58:51.785488 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 313/608] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:51 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:51.818544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:51.826220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-619a8f23-67f3-4fd8-a0ec-e77d344898ef tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1577 microversion: 2.1 time: 0.161297 Jul 26 14:58:51.826798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 296/609] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:51 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:52.806291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:52.806901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:52.808801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:52.815009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:52.822357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:52.822357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:52.822357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:52.847522 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:52.848347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:52.850404 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:52.852155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:52.854613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:58:52.865100 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:52.865655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:52.866667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:52.867183 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:52.958784 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:52.966733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d5c78d1f-3075-4d80-97f1-d020d08389a6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.164201 Jul 26 14:58:52.967617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 314/610] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:52 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:53.537080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:53.544678 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bcb239f6-7cdc-4579-94e4-1b534da712fb tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1577 microversion: 2.1 time: 0.701326 Jul 26 14:58:53.545452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 297/611] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:52 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1577 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:58:53.862376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-60c32577-a056-4a5e-a592-725aae4a02e9 req-dcd139c0-2ddd-4ae0-9d75-d0bea39bc373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171f8b78-1bb9-4ab8-9e8e-78aaf0208adb", "name": "network-vif-deleted", "tag": "5dc5b800-3fb7-4da8-865c-4676b8e74a36"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:53.873026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-60c32577-a056-4a5e-a592-725aae4a02e9 req-dcd139c0-2ddd-4ae0-9d75-d0bea39bc373 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:53.873478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-60c32577-a056-4a5e-a592-725aae4a02e9 req-dcd139c0-2ddd-4ae0-9d75-d0bea39bc373 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:53.886359 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-60c32577-a056-4a5e-a592-725aae4a02e9 req-dcd139c0-2ddd-4ae0-9d75-d0bea39bc373 service nova] Creating event network-vif-deleted:5dc5b800-3fb7-4da8-865c-4676b8e74a36 for instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb on hv-cinder-85103 Jul 26 14:58:53.891759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-60c32577-a056-4a5e-a592-725aae4a02e9 req-dcd139c0-2ddd-4ae0-9d75-d0bea39bc373 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035373 Jul 26 14:58:53.892462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 315/612] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:53.988229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:53.988848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:53.995394 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:53.995959 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:53.996658 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:53.997102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.133422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:54.141627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fa05c97b-0a4f-4512-b925-91478e9c601b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.157387 Jul 26 14:58:54.142200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 298/613] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:53 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:54.571579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:54.571579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:54.576714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:54.577222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.577994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:54.578431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:54.647301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ae70024479e488c90c6c1b955cb6471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7107f9317c24cc7b972fdc6b8c01322', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:54.655501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-09c34040-e080-4e28-b8c7-f807f7f98e56 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 200 len: 1225 microversion: 2.1 time: 0.090752 Jul 26 14:58:54.660090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 316/614] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:54 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:55.164891 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:55.165469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:55.172510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.172960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.173816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.174251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.311951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:55.319800 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-12086d8a-dae8-4e8e-9a76-833261a9fb54 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.158933 Jul 26 14:58:55.320362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 299/615] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:55 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:55.675458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:55.675980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] [instance: 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:55.682538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.682990 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.683854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:55.684293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:55.698871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] HTTP exception thrown: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Request method failure captured: Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb HTTP/1.1 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3__xK0SAFYRIjosbYp8ImOvfIfm2kFmAGMdVahKFy8pTCGoENZnBfyE5dXRuF65h4KLylEhmvKeBnc8VCoQRzujcWIgUPGTA1qByEMt8Udl5rkIaZ7-yJdjWm0V86qiX_Vx47lJhdDz6RhTbXSxNux_M7eYddkh88EW1B70L_TH-66E Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: e7107f9317c24cc7b972fdc6b8c01322 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-TestVolumeBootPattern-2120727931 Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:58:55.700565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_e7107f9317c24cc7b972fdc6b8c01322"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e7107f9317c24cc7b972fdc6b8c01322"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e7107f9317c24cc7b972fdc6b8c01322"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/e7107f9317c24cc7b972fdc6b8c01322"}]}] Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-TestVolumeBootPattern-2120727931 Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: e7107f9317c24cc7b972fdc6b8c01322 Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-TestVolumeBootPattern-2120727931 Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-TestVolumeBootPattern-2120727931-project Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 2ae70024479e488c90c6c1b955cb6471 Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-TestVolumeBootPattern-2120727931-project Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. Jul 26 14:58:55.702261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '171f8b78-1bb9-4ab8-9e8e-78aaf0208adb'} Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:58:55.703931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. Jul 26 14:58:55.705399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:58:55.706789 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Returning 404 to user: Instance 171f8b78-1bb9-4ab8-9e8e-78aaf0208adb could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:58:55.706789 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-280e1024-cde0-4b32-b64e-63cf549e9ee7 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb" status: 404 len: 111 microversion: 2.1 time: 0.030496 Jul 26 14:58:55.706789 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 317/616] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:55 2022] GET /compute/v2.1/servers/171f8b78-1bb9-4ab8-9e8e-78aaf0208adb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:58:56.341374 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:56.342022 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:56.348889 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.353001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.353001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.353001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.490672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:56.497691 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c004ff6d-b5cf-4aec-b837-d42b1888a138 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.160257 Jul 26 14:58:56.498286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 300/617] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:56 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:56.605853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-ead0e906-fa19-43e4-b87d-d6996aa8323e req-274e50ca-b065-439f-a853-531ec0726e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b3ca784-f197-4dfa-8592-742a8cb0b832", "name": "network-vif-plugged", "status": "completed", "tag": "9b0e3837-4947-4f14-b8b9-6a4f6f25c7be"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:58:56.615764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-ead0e906-fa19-43e4-b87d-d6996aa8323e req-274e50ca-b065-439f-a853-531ec0726e79 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:56.616211 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-ead0e906-fa19-43e4-b87d-d6996aa8323e req-274e50ca-b065-439f-a853-531ec0726e79 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:56.627776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-ead0e906-fa19-43e4-b87d-d6996aa8323e req-274e50ca-b065-439f-a853-531ec0726e79 service nova] Creating event network-vif-plugged:9b0e3837-4947-4f14-b8b9-6a4f6f25c7be for instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 on hv-cinder-85103 Jul 26 14:58:56.632724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-ead0e906-fa19-43e4-b87d-d6996aa8323e req-274e50ca-b065-439f-a853-531ec0726e79 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088302 Jul 26 14:58:56.633360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 318/618] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:58:57.299883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6d1aa95f-7bcd-48fb-b7d6-b366dbf2d406 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] Calling method '.version_select at 0x7f97e629dee0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:57.375445 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6d1aa95f-7bcd-48fb-b7d6-b366dbf2d406 tempest-TestVolumeBootPattern-2120727931 tempest-TestVolumeBootPattern-2120727931-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694483227" status: 202 len: 0 microversion: 2.1 time: 0.080170 Jul 26 14:58:57.376076 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 301/619] 10.222.0.97 () {58 vars in 1263 bytes} [Tue Jul 26 14:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694483227 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:58:57.520610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:57.521367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:57.527965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:57.528418 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:57.529216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:57.529703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:57.663291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:57.670901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-41574622-bf11-4218-a958-2f0a323ae8e2 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.155520 Jul 26 14:58:57.671483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 319/620] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:57 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:58.692752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:58.693487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:58.701190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:58.701773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:58.702962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:58.703540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:58.930855 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:58:58.938899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-db3a9b88-8dda-4d6b-94d5-236384d4606d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1367 microversion: 2.1 time: 0.250586 Jul 26 14:58:58.939710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 302/621] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:58 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:58:59.959284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:58:59.959955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:58:59.967286 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:59.967772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:58:59.969109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:58:59.969546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:00.107791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:00.116262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7f711cb9-4c3a-4c10-81ec-a15e1eb04fdf tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1558 microversion: 2.1 time: 0.160697 Jul 26 14:59:00.116995 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 320/622] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:58:59 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:00.142899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:00.143423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:00.150170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:00.155040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:00.155040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:00.155040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:00.320557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bb10daef-a1df-4687-8141-1c0316150589 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182044 Jul 26 14:59:00.321284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 303/623] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 14:59:00 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:01.681516 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-0389764e-5c62-4c7d-957e-99be2005b741 req-99c0aa0d-1d2b-4839-8ffc-92a7c4ae0dee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b3ca784-f197-4dfa-8592-742a8cb0b832", "tag": "9b0e3837-4947-4f14-b8b9-6a4f6f25c7be"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:01.691684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0389764e-5c62-4c7d-957e-99be2005b741 req-99c0aa0d-1d2b-4839-8ffc-92a7c4ae0dee service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:01.692237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0389764e-5c62-4c7d-957e-99be2005b741 req-99c0aa0d-1d2b-4839-8ffc-92a7c4ae0dee service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:01.704147 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-0389764e-5c62-4c7d-957e-99be2005b741 req-99c0aa0d-1d2b-4839-8ffc-92a7c4ae0dee service nova] Creating event network-changed:9b0e3837-4947-4f14-b8b9-6a4f6f25c7be for instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 on hv-cinder-85103 Jul 26 14:59:01.710409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-0389764e-5c62-4c7d-957e-99be2005b741 req-99c0aa0d-1d2b-4839-8ffc-92a7c4ae0dee service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093841 Jul 26 14:59:01.711242 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 321/624] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:31.585571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.586390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=36 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.590441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:31.590942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:31.597060 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:31.597523 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:31.598383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:31.598826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:31.680089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'services' on Instance uuid b501f137-fb1d-40f6-88c9-646247bebae0 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:31.956484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bd70e8d3-bd24-42a9-aa8f-6b0d5a13d19e tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments/137ae5a9-b1e1-469c-a127-73f1f56e2b82" status: 202 len: 0 microversion: 2.1 time: 0.372147 Jul 26 14:59:31.957129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 304/625] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 14:59:31 2022] DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments/137ae5a9-b1e1-469c-a127-73f1f56e2b82 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:59:31.967050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:31.969363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:31.971580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.972221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=46 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:31.977233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:31.977682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:31.978499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:31.978936 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.009691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dac1e75e-92e7-4ab6-92bb-45a60c04bbef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047886 Jul 26 14:59:32.010250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 322/626] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:59:31 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:32.230134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:32.233921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:32.242169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.242853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.243687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.244130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.275395 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-357dbe05-6efb-4d27-93c6-6077527083c8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049534 Jul 26 14:59:32.275974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 305/627] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:59:32 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 14:59:32.337163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:32.337656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:32.345190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.345660 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.346440 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.346869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.371855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:59:32.700155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-00e9b88f-8033-4338-8acc-7385f5b8ff48 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 204 len: 0 microversion: 2.1 time: 0.365855 Jul 26 14:59:32.700928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 323/628] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:59:32 2022] DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:59:32.709901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:32.713660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:32.718017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.718478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.719266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:32.719732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:32.850968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:32.859006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fdda4a62-f4e0-4a10-b643-4845f845da56 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1672 microversion: 2.1 time: 0.152976 Jul 26 14:59:32.862124 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 306/629] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:32 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:33.022915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:33.025448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:33.033407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:33.033857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:33.034646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:33.035081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:33.067160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-31cfdb0e-85ce-4199-b0db-279c4189951a tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048564 Jul 26 14:59:33.067755 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 324/630] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:59:33 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:33.882202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:33.882822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:33.890101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:33.890554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:33.891327 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:33.891797 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:34.028640 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:34.036683 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-311f738f-6935-4b91-a256-77c4bed2dcac tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1672 microversion: 2.1 time: 0.158341 Jul 26 14:59:34.037258 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 307/631] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:33 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:34.080400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:34.083127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:34.089924 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:34.091037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:34.091154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:34.091616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:34.126943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c153c692-6ff0-49e2-8510-46c68ab489db tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051758 Jul 26 14:59:34.127530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 325/632] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:59:34 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:35.059203 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:35.059847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:35.067186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.067667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.068452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.068879 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.184572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:35.184572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:35.185319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:35.185423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.185423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.185423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.185423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.185709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-43a50ab6-4f0d-44a9-840f-2d21436f963e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1605 microversion: 2.1 time: 0.099043 Jul 26 14:59:35.185709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 308/633] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:35 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:35.185972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9ed110c1-2b61-49eb-b98e-628a582eb5f7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048779 Jul 26 14:59:35.185972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 326/634] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 14:59:35 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 14:59:35.273365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:35.274227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:35.284579 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.288347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.288347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.288347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.315920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:59:35.452315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-fff9af4a-43dd-441c-9166-9988eb275b3a req-863bf156-e639-4b29-bfc0-956828f5a40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1552ebb-d614-4398-96ba-47e3fd737e3d", "name": "network-vif-deleted", "tag": "f52ee38e-091f-4eb3-93dc-683dcd709ebd"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:35.466381 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-fff9af4a-43dd-441c-9166-9988eb275b3a req-863bf156-e639-4b29-bfc0-956828f5a40f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.466381 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-fff9af4a-43dd-441c-9166-9988eb275b3a req-863bf156-e639-4b29-bfc0-956828f5a40f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.475684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-fff9af4a-43dd-441c-9166-9988eb275b3a req-863bf156-e639-4b29-bfc0-956828f5a40f service nova] Creating event network-vif-deleted:f52ee38e-091f-4eb3-93dc-683dcd709ebd for instance d1552ebb-d614-4398-96ba-47e3fd737e3d on hv-cinder-85103 Jul 26 14:59:35.481049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-fff9af4a-43dd-441c-9166-9988eb275b3a req-863bf156-e639-4b29-bfc0-956828f5a40f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033051 Jul 26 14:59:35.481743 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 327/635] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:35.699772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-41c76bb9-bec1-4fcb-9230-f6a231182453 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 204 len: 0 microversion: 2.1 time: 0.433542 Jul 26 14:59:35.700635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 309/636] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:59:35 2022] DELETE /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 14:59:35.710844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:35.711742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:35.718712 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.719120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.719941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:35.720390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:35.859849 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:35.867594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9203fc25-b634-4ccc-a769-f1d9f40d86d8 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1690 microversion: 2.1 time: 0.162153 Jul 26 14:59:35.868158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 328/637] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:35 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:36.177776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:36.178472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:36.185326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:36.186273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:36.187076 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:36.187540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:36.221016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:36.221524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:36.221898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'fault' on Instance uuid d1552ebb-d614-4398-96ba-47e3fd737e3d {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:36.268406 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:36.276406 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2a5ea9a6-0b06-48e6-b91d-29974b3d96bb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1326 microversion: 2.1 time: 0.103052 Jul 26 14:59:36.276963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 310/638] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:36 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:36.891456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:36.891996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:36.898836 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:36.899313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:36.900109 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:36.900549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.029143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:37.036626 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2e0667b7-8b88-4797-af3a-1b40d1a7ec61 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1690 microversion: 2.1 time: 0.149762 Jul 26 14:59:37.037197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 329/639] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:36 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:37.256767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:37.257312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:37.263787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.264846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.265622 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.266058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.289330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lazy-loading 'flavor' on Instance uuid df55a650-eac7-41dd-8361-bb02fc6d25f6 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:37.297993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:37.298608 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:37.304646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.305097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.305868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.306303 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.337121 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.337573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.338022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'fault' on Instance uuid d1552ebb-d614-4398-96ba-47e3fd737e3d {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:37.379170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:37.386645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-acca669c-6315-4a70-9b6c-581302ea295a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1326 microversion: 2.1 time: 0.092962 Jul 26 14:59:37.387210 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 330/640] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:37 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:37.715219 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-630a52f7-99a6-4cee-928a-73e36d297dfa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "POST /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6/action" status: 202 len: 0 microversion: 2.1 time: 0.462363 Jul 26 14:59:37.715839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 311/641] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:59:37 2022] POST /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:59:37.724752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:37.725572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:37.731360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.731841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.732615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:37.733697 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:37.875307 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:37.883171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-99f69b1f-8331-4507-9177-7e171ff71f06 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.162201 Jul 26 14:59:37.883804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 331/642] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:37 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:38.058155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:38.058857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:38.065121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.065568 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.066336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.066767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.204614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:38.212202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cf7ff2f6-4e6f-4aca-974c-121d4985cf83 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1690 microversion: 2.1 time: 0.158317 Jul 26 14:59:38.212769 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 312/643] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:38 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:38.408207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:38.408760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:38.415230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.415717 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.416486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.416928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.449522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.449975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.450429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'fault' on Instance uuid d1552ebb-d614-4398-96ba-47e3fd737e3d {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:38.492428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:38.500544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6224130d-2cc0-42a3-8df4-60203955854a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1326 microversion: 2.1 time: 0.096269 Jul 26 14:59:38.501099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 332/644] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:38 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:38.906399 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:38.907005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:38.913807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.914277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:38.915050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:38.915506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.054517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:39.062342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-51596ce5-96a2-47e8-af42-4b061a2dbccd tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.160313 Jul 26 14:59:39.062989 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 313/645] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:38 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:39.234575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:39.235173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:39.241137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:39.241592 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.242362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:39.242802 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.395765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:39.395765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4b396834-c424-45c3-9a15-8415fd5a8aa0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1690 microversion: 2.1 time: 0.160679 Jul 26 14:59:39.395765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 333/646] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:39 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:39.521601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:39.522217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:39.528544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:39.528996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.530385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:39.530832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.562121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:39.562567 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:39.563017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'fault' on Instance uuid d1552ebb-d614-4398-96ba-47e3fd737e3d {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:39.605340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:39.613464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-236b0ccf-a302-447d-a68b-2bdc1a96bef8 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 200 len: 1326 microversion: 2.1 time: 0.095744 Jul 26 14:59:39.614026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 314/647] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:39 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 1326 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:40.085182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:40.085814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:40.092961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.093405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.094170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.094620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.254902 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:40.262869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3258d02f-982a-449c-80ac-1178c307497d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.181622 Jul 26 14:59:40.263642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 334/648] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:40 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:40.413258 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:40.414140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:40.420543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.423118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.423118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.423118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.441043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:40.585483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:40.594619 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8aa40cc5-c302-4761-a820-2bfd388a29a2 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1690 microversion: 2.1 time: 0.185226 Jul 26 14:59:40.605931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 315/649] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:40 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:40.634793 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:40.635423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:40.642394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.642844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.643645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.644084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.659517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d HTTP/1.1 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:59:40.677247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 14:59:40.679006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'd1552ebb-d614-4398-96ba-47e3fd737e3d'} Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:59:40.680054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 14:59:40.681500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:40.682678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:59:40.682678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-66aa744c-58e9-4e89-b940-23cd3ef672bd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 404 len: 111 microversion: 2.1 time: 0.032066 Jul 26 14:59:40.682678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 335/650] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:40 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:59:40.682931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d772b192-5c5d-47a7-9c9b-ea7c115ec386 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '.version_select at 0x7f97e63cd940>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:40.763832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d772b192-5c5d-47a7-9c9b-ea7c115ec386 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807930728" status: 202 len: 0 microversion: 2.1 time: 0.095596 Jul 26 14:59:40.764510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 316/651] 10.222.0.97 () {58 vars in 1218 bytes} [Tue Jul 26 14:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807930728 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:59:40.872760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-89023b5a-5477-4be0-a83a-871df2b01d22 req-7fe136d0-a172-43c9-ba11-e517d16bab4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b501f137-fb1d-40f6-88c9-646247bebae0", "name": "network-vif-deleted", "tag": "f0af75a9-00b5-407e-a458-c93ec4a7c4ed"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:40.887727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-89023b5a-5477-4be0-a83a-871df2b01d22 req-7fe136d0-a172-43c9-ba11-e517d16bab4e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:40.888156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-89023b5a-5477-4be0-a83a-871df2b01d22 req-7fe136d0-a172-43c9-ba11-e517d16bab4e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:40.901676 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-89023b5a-5477-4be0-a83a-871df2b01d22 req-7fe136d0-a172-43c9-ba11-e517d16bab4e service nova] Creating event network-vif-deleted:f0af75a9-00b5-407e-a458-c93ec4a7c4ed for instance b501f137-fb1d-40f6-88c9-646247bebae0 on hv-cinder-85103 Jul 26 14:59:40.907879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-89023b5a-5477-4be0-a83a-871df2b01d22 req-7fe136d0-a172-43c9-ba11-e517d16bab4e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038961 Jul 26 14:59:40.908721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 336/652] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:41.284916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:41.286069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:41.294279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:41.295020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:41.296347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:41.297354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:41.508261 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:41.517670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-85717754-0146-41ee-8a29-cd9e4fcf876c tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.236959 Jul 26 14:59:41.518263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 317/653] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:41 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:41.617307 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:41.618184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:41.625684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:41.626160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:41.627280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:41.627774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:41.660265 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:41.660729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:41.661168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'fault' on Instance uuid b501f137-fb1d-40f6-88c9-646247bebae0 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:41.718196 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:41.721907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:41.726573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-845ff788-90c0-4a46-bc40-bf8bfc3db5e7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 200 len: 1335 microversion: 2.1 time: 0.113710 Jul 26 14:59:41.727422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 337/654] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:41 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 1335 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:41.792599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-26117cde-ee71-4971-a06e-b59a28965ee7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: .version_select at 0x7f97e637d310>, body: {"keypair": {"name": "tempest-keypair-2072286327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGzTUQ9LXYcMvxYrIL6IcU4VcuNxzgiwdeQjoBD7iRlK8kaSk9Il0WMhoNI/rxWp7Sppa3r8HHkfRazv7XkTD0g5yDsWPHXRsv1075fMjYUEGRRTsrfld+JWGMUPdE4Pg=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:41.816057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-26117cde-ee71-4971-a06e-b59a28965ee7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:59:41.820828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-26117cde-ee71-4971-a06e-b59a28965ee7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for user e0615d20057342cfbd16aa0ec94d1979 and project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:59:41.941233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-26117cde-ee71-4971-a06e-b59a28965ee7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152682 Jul 26 14:59:41.947876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 318/655] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 14:59:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:42.540267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:42.541010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:42.548316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:42.548768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:42.549540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:42.549979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:42.732184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:42.740404 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f84aad6e-4235-4c09-bfe7-84802718986f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.204431 Jul 26 14:59:42.740975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 338/656] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:42 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:42.750650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:42.751271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: b501f137-fb1d-40f6-88c9-646247bebae0] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:42.757660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:42.761779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:42.761779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:42.761779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:42.774235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] HTTP exception thrown: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Request method failure captured: Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 HTTP/1.1 Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-PIfzinAT7j3dv57JccSfrAoVCFVjPpG63tDdFDSnC52c_acC3y6ADqFz9G26qAkZXun6SvpAH2C0ZO-InmiQ04DNJOkLRJcpJbyyIHtF_ueuNI8AIzuWIkxAkgONA_gAYkJcQ9wt_v4sz0kFRjBzbyQ60U6zhA0LHE3brfHBo5ss Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:59:42.775975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4f3f79533bbf48018798e6e65050d69c"}]}] Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 19c0408b4321495eabd4738bbb8b711b Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. Jul 26 14:59:42.781178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'b501f137-fb1d-40f6-88c9-646247bebae0'} Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:59:42.782044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. Jul 26 14:59:42.783480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:42.784784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Returning 404 to user: Instance b501f137-fb1d-40f6-88c9-646247bebae0 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:59:42.784784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-06fc509c-588d-4289-a117-da94a18c5164 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0" status: 404 len: 111 microversion: 2.1 time: 0.031310 Jul 26 14:59:42.784784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 319/657] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:42 2022] GET /compute/v2.1/servers/b501f137-fb1d-40f6-88c9-646247bebae0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:59:42.787089 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-06d87ce7-810a-44c0-8e43-15b8b8832090 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '.version_select at 0x7f97e6292430>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:42.866887 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-06d87ce7-810a-44c0-8e43-15b8b8832090 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505293295" status: 202 len: 0 microversion: 2.1 time: 0.083633 Jul 26 14:59:42.867505 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 339/658] 10.222.0.97 () {58 vars in 1218 bytes} [Tue Jul 26 14:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505293295 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 14:59:43.761462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:43.768048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:43.769135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:43.769606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:43.770385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:43.770930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:43.920956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:43.928689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8784d394-7148-4840-8ca0-c795f9a75e1a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.171256 Jul 26 14:59:43.929295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 320/659] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:43 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:44.876163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-279309695", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "02c3d9d5-b71e-4ad5-9373-5d17164e8aec"}], "security_groups": [{"name": "tempest-securitygroup--1452392663"}], "key_name": "tempest-keypair-2072286327", "user_data": "}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:44.949519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:44.952863 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:44.962568 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:44.963024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:44.966774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:44.967855 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:44.987332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] validate_networks() for [('02c3d9d5-b71e-4ad5-9373-5d17164e8aec', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 14:59:45.127658 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:45.135573 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9c81278b-4c31-470d-ae46-5c67b507c464 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.189965 Jul 26 14:59:45.137483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 321/660] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:44 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:45.517661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 14:59:45.518108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 14:59:45.518631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 14:59:45.519111 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 14:59:45.519625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 14:59:45.529376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:45.529827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:45.530653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:45.531094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:45.549106 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 14:59:45.562096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Getting quotas for user e0615d20057342cfbd16aa0ec94d1979 and project 7ccd4ff518dc4c37bfb7f343ccc97206. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 14:59:45.564899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 14:59:45.567161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 14:59:45.771882 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-514b20e3-7622-472a-8ab4-673ad58f30e1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.900538 Jul 26 14:59:45.772722 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 340/661] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 14:59:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 14:59:45.785672 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ca4e351a-0651-4fbe-aa02-5d82c206e78f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:45.786642 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ca4e351a-0651-4fbe-aa02-5d82c206e78f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:45.843427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ca4e351a-0651-4fbe-aa02-5d82c206e78f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:45.850131 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ca4e351a-0651-4fbe-aa02-5d82c206e78f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1237 microversion: 2.1 time: 0.068655 Jul 26 14:59:45.850705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 322/662] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:45 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:46.157938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:46.161503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:46.165256 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.165728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.166486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.166922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.318648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:46.326528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b9872f95-ff82-4d5e-a621-f866bce5a08d tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.172993 Jul 26 14:59:46.331977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 341/663] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:46 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:46.387726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:46.389227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:46.394928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.395309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.396198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.396573 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.425655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:59:46.738616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c3455d03-7dfb-466b-b52c-55b55c4673d9 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 204 len: 0 microversion: 2.1 time: 0.354287 Jul 26 14:59:46.738996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 323/664] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:59:46 2022] DELETE /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:59:46.747331 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:46.748111 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:46.754553 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.755006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.755835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.756274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.872209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:46.873083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:46.879187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.879670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.880444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:46.880883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:46.887175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:46.896395 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ab53aa2e-ee23-4ae6-bd8b-e0461d17cdef tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1509 microversion: 2.1 time: 0.153156 Jul 26 14:59:46.902881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 342/665] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:46 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:46.944274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:46.953820 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-48403752-59ff-4dc4-bf37-06f6ccd21a65 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1241 microversion: 2.1 time: 0.086015 Jul 26 14:59:46.954402 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 324/666] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:46 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:47.347665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:47.348276 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:47.355274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.355750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:47.356549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.356982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:47.495881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:47.502428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-91030998-3d08-42a5-b159-2fe19708e187 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.158689 Jul 26 14:59:47.503017 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 343/667] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:47 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:47.918166 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:47.918777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:47.925977 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.926429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:47.927198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.927664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:47.974155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:47.974773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:47.984379 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.984843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:47.985633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:47.986076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:48.048707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:48.058445 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7ba5906e-b125-418c-9ab3-4c8771f8af68 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1233 microversion: 2.1 time: 0.088049 Jul 26 14:59:48.059217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 344/668] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:47 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:48.068919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:48.076944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3823f65b-f900-4a6a-87c9-0136b1b0fce4 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1509 microversion: 2.1 time: 0.162508 Jul 26 14:59:48.077444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 325/669] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:47 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:48.524918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:48.530380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:48.532907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:48.533398 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:48.534168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:48.534669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:48.626253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-910ad74e-223e-4aa8-8520-57aa2280f342 req-4a9dddfa-b10d-479b-8ddb-781f6919d1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a97d630c-f890-4022-87ba-406020a397dc", "name": "network-vif-deleted", "tag": "098d52c8-2012-4286-962d-62149a4873c1"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:48.636867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-910ad74e-223e-4aa8-8520-57aa2280f342 req-4a9dddfa-b10d-479b-8ddb-781f6919d1f1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:48.637632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-910ad74e-223e-4aa8-8520-57aa2280f342 req-4a9dddfa-b10d-479b-8ddb-781f6919d1f1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:48.650818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-910ad74e-223e-4aa8-8520-57aa2280f342 req-4a9dddfa-b10d-479b-8ddb-781f6919d1f1 service nova] Creating event network-vif-deleted:098d52c8-2012-4286-962d-62149a4873c1 for instance a97d630c-f890-4022-87ba-406020a397dc on hv-cinder-85103 Jul 26 14:59:48.656165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-910ad74e-223e-4aa8-8520-57aa2280f342 req-4a9dddfa-b10d-479b-8ddb-781f6919d1f1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033896 Jul 26 14:59:48.662292 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 326/670] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 14:59:48.689175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:48.697114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-feca8f5c-42bd-4db5-9a38-43432e74e7d7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.176377 Jul 26 14:59:48.697713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 345/671] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:48 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:49.080962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:49.081774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:49.088199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.097006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:49.097006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.097006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:49.100199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:49.100852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:49.107055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.108182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:49.109071 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.109511 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:49.154313 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:49.163445 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6b43d791-e534-4fd0-8ab3-614161f70551 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1289 microversion: 2.1 time: 0.087719 Jul 26 14:59:49.164344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 327/672] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:49 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:49.177542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:49.185025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b1d50814-91a5-41aa-aa54-09775b1d1e3b tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1293 microversion: 2.1 time: 0.090193 Jul 26 14:59:49.186206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 346/673] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:49 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:49.720036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:49.720680 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:49.726719 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.727169 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:49.727985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:49.728424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.016136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:50.025063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-96093caf-47f3-43d9-b954-95a1a6beb75f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.309457 Jul 26 14:59:50.025662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 328/674] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:49 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:50.185811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:50.186407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:50.193940 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:50.194560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.195393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:50.195844 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.207047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:50.207689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:50.214684 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:50.220872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.221971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:50.225766 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.278549 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:50.279026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:50.279617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'fault' on Instance uuid a97d630c-f890-4022-87ba-406020a397dc {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:50.305511 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:50.313852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a31da2ed-0d03-47b5-a88d-027917157058 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1295 microversion: 2.1 time: 0.131980 Jul 26 14:59:50.314432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 347/675] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:50 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:50.357040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:50.364041 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e4fef73b-0292-484f-a8dc-9d3272b4468c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 200 len: 1312 microversion: 2.1 time: 0.160967 Jul 26 14:59:50.370115 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 329/676] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:50 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:51.047629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:51.048247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:51.055441 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.055899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.056680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.057117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.189242 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:51.197257 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-074eb85a-378b-4fdb-9d3b-bbaa511f95af tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.154234 Jul 26 14:59:51.197823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 348/677] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:51 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:51.336366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:51.336916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:51.343733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.344187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.344962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.345401 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.390586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:51.391335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: a97d630c-f890-4022-87ba-406020a397dc] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:51.397538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.397987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.399021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.399485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.414426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] HTTP exception thrown: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Request method failure captured: Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc HTTP/1.1 Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-PIfzinAT7j3dv57JccSfrAoVCFVjPpG63tDdFDSnC52c_acC3y6ADqFz9G26qAkZXun6SvpAH2C0ZO-InmiQ04DNJOkLRJcpJbyyIHtF_ueuNI8AIzuWIkxAkgONA_gAYkJcQ9wt_v4sz0kFRjBzbyQ60U6zhA0LHE3brfHBo5ss Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 14:59:51.416113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4f3f79533bbf48018798e6e65050d69c"}]}] Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 19c0408b4321495eabd4738bbb8b711b Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. Jul 26 14:59:51.417669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'a97d630c-f890-4022-87ba-406020a397dc'} Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:59:51.418534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. Jul 26 14:59:51.419982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 14:59:51.421220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Returning 404 to user: Instance a97d630c-f890-4022-87ba-406020a397dc could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:59:51.421220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3fc0b6f0-8365-465c-a101-c1ed191ad5fc tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc" status: 404 len: 111 microversion: 2.1 time: 0.031320 Jul 26 14:59:51.421220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 349/678] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:51 2022] GET /compute/v2.1/servers/a97d630c-f890-4022-87ba-406020a397dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 14:59:51.425950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:51.426451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:51.434792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.438070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.438969 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.439442 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.465862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 14:59:51.484185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:51.492198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7365785f-7ce6-4275-8a36-1fc313457972 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.159855 Jul 26 14:59:51.493592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 330/679] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:51 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:51.784226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cdb8cbb2-39ce-4e87-84bd-9b0fadc5d63c tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 204 len: 0 microversion: 2.1 time: 0.361748 Jul 26 14:59:51.784813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 350/680] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 14:59:51 2022] DELETE /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 14:59:51.793184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:51.793798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:51.801863 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.802572 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.803376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:51.803865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:51.948726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:51.954279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-513850ce-0a26-4718-a592-aa82f51e7bf0 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.164785 Jul 26 14:59:51.954871 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 331/681] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:51 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:52.220156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:52.220938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:52.228744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.229191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:52.229964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.230400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:52.370960 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:52.379366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bde16b3e-5bad-46ee-bb48-34d444dee37a tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.164396 Jul 26 14:59:52.379974 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 351/682] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:52 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:52.513234 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:52.513953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:52.521201 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.521663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:52.522460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.522905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:52.793916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:52.802441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-89c32667-41f7-437b-afad-91e31fe71afd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.293126 Jul 26 14:59:52.803248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 332/683] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:52 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:52.976410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:52.977086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:52.984283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.986011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:52.986011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:52.986305 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:53.123904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:53.132312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-26a5f3b6-9dcf-4415-8c25-5b716167bc89 req-40ba783c-3079-470b-b472-12cd6136b674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60aed9b-d83f-478b-be96-86d4e4a6ce9c", "tag": "df255ca8-fb3a-4312-b426-006fe4958576"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:53.136453 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0be158bc-0f7f-4350-8e0c-696d4462c428 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.163836 Jul 26 14:59:53.144893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 352/684] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:52 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:53.154050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-26a5f3b6-9dcf-4415-8c25-5b716167bc89 req-40ba783c-3079-470b-b472-12cd6136b674 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:53.154605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-26a5f3b6-9dcf-4415-8c25-5b716167bc89 req-40ba783c-3079-470b-b472-12cd6136b674 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:53.166984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-26a5f3b6-9dcf-4415-8c25-5b716167bc89 req-40ba783c-3079-470b-b472-12cd6136b674 service nova] Creating event network-changed:df255ca8-fb3a-4312-b426-006fe4958576 for instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c on hv-cinder-85103 Jul 26 14:59:53.172707 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-26a5f3b6-9dcf-4415-8c25-5b716167bc89 req-40ba783c-3079-470b-b472-12cd6136b674 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043689 Jul 26 14:59:53.173315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 333/685] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:59:53.401060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:53.401687 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:53.406707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:53.410645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:53.411553 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:53.412487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:53.413080 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:53.559074 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:53.567368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d3d1a38d-f822-495b-8016-b665c0ded7f7 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.170456 Jul 26 14:59:53.568173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 353/686] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:53 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:53.824666 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:53.825441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:53.833294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:53.833750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:53.834547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:53.834992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.159178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:54.159828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:54.187617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.187998 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.188922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.189372 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.209448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:54.217464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c7e603e8-7624-4b02-ae1f-cf3005368b70 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.397148 Jul 26 14:59:54.219254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 334/687] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:53 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:54.344403 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:54.354493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3d1aa081-a9e8-4807-a8f3-ff0af17e43d7 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1521 microversion: 2.1 time: 0.200045 Jul 26 14:59:54.355078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 354/688] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:54 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:54.590665 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:54.592034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:54.604266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.604869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.606175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.606730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.616651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:54.832040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:54.840162 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-dbca1b2d-ee7a-4546-8ed2-be2ed6cb27c0 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1569 microversion: 2.1 time: 0.254498 Jul 26 14:59:54.840656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 335/689] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:54 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:54.861716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:54.862439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:54.869625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.870081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.870847 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:54.871280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:54.875301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:55.210638 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-a3432416-25bb-4300-aabe-a2b33492d6d7 req-c492f78a-392e-444d-b779-efacce10e1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef4043a-5d67-4091-abcb-ed5e596ba355", "name": "network-vif-deleted", "tag": "a5d6c726-a2d1-4d56-97ab-81d623c53ac3"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:55.220830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-a3432416-25bb-4300-aabe-a2b33492d6d7 req-c492f78a-392e-444d-b779-efacce10e1ff service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.221267 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-a3432416-25bb-4300-aabe-a2b33492d6d7 req-c492f78a-392e-444d-b779-efacce10e1ff service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.233253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-986e224b-183c-4ba3-b31a-bc290634dd78 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "POST /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6/action" status: 202 len: 0 microversion: 2.1 time: 0.375986 Jul 26 14:59:55.233832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-a3432416-25bb-4300-aabe-a2b33492d6d7 req-c492f78a-392e-444d-b779-efacce10e1ff service nova] Creating event network-vif-deleted:a5d6c726-a2d1-4d56-97ab-81d623c53ac3 for instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 on hv-cinder-85103 Jul 26 14:59:55.234363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 355/690] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 14:59:54 2022] POST /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 14:59:55.238784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-a3432416-25bb-4300-aabe-a2b33492d6d7 req-c492f78a-392e-444d-b779-efacce10e1ff service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032311 Jul 26 14:59:55.239439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 336/691] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 14:59:55.242768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:55.243486 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:55.247470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:55.248673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:55.251464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.251814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:55.252464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.253340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.253876 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.255543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.255994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.256843 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.257255 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.401654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:55.401947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:55.410292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-661eb5ab-f738-40bd-853e-af5c59fe4333 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.171300 Jul 26 14:59:55.411037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 356/692] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:55 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:55.414116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6ee9531e-4ca6-45a1-9c47-5ab670157bbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1517 microversion: 2.1 time: 0.170595 Jul 26 14:59:55.415038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 337/693] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:55 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:55.416012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:55.416651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:55.425340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.426204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.427701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.429713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.473039 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:55.473524 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:55.473980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'fault' on Instance uuid 2ef4043a-5d67-4091-abcb-ed5e596ba355 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:55.543139 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:55.543139 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b95771b7-5269-434f-9800-af34f95d3324 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1311 microversion: 2.1 time: 0.117198 Jul 26 14:59:55.543139 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 357/694] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:55 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1311 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:56.432606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:56.433294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:56.436137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:56.441681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.442129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.442938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.443373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.457791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:56.464850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:56.464850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:56.464850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 14:59:56.466740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.467201 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.468019 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.468459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.590651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:56.598319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-da69a1ff-5631-438e-b8a0-632c3da09c78 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.170237 Jul 26 14:59:56.598900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 338/695] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:56 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:56.604148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:56.604956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:56.611735 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.612443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.613391 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.613997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.633281 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:56.642051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c18f2c26-078c-4417-bb95-4022c3f916e6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1517 microversion: 2.1 time: 0.188302 Jul 26 14:59:56.642724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 358/696] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:56 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:56.648035 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-8d075149-4087-46ae-84ff-61178952a065 req-89f133a0-24b6-4111-aba6-805688b7235b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "name": "network-vif-unplugged", "status": "completed", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 14:59:56.648912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.649598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.650188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'fault' on Instance uuid 2ef4043a-5d67-4091-abcb-ed5e596ba355 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:56.658229 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-8d075149-4087-46ae-84ff-61178952a065 req-89f133a0-24b6-4111-aba6-805688b7235b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:56.658749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-8d075149-4087-46ae-84ff-61178952a065 req-89f133a0-24b6-4111-aba6-805688b7235b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:56.671246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.compute.server_external_events [req-8d075149-4087-46ae-84ff-61178952a065 req-89f133a0-24b6-4111-aba6-805688b7235b service nova] Unable to find a host for instance df55a650-eac7-41dd-8361-bb02fc6d25f6. Dropping event network-vif-unplugged {{(pid=124889) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 14:59:56.672171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-8d075149-4087-46ae-84ff-61178952a065 req-89f133a0-24b6-4111-aba6-805688b7235b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028126 Jul 26 14:59:56.672794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 359/697] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 14:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 26 14:59:56.695751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:56.703464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-da08be29-e9bc-44d1-be48-0ce749c3c157 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1311 microversion: 2.1 time: 0.103252 Jul 26 14:59:56.704052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 339/698] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:56 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:57.621096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:57.621686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:57.630437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.630893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.631686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.632126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.664217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:57.664831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:57.673235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.673754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.674538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.674979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.774380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:57.782812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c80401a6-d29b-4476-90ed-622bb6dcd13a tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.165759 Jul 26 14:59:57.783374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 360/699] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:57 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:57.788052 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:57.788656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:57.795292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.796030 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.796988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.797428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.819089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:57.826730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-96308e2e-9a5f-4895-b2ab-ec5ab7f7dd61 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1517 microversion: 2.1 time: 0.166442 Jul 26 14:59:57.827499 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 340/700] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:57 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:57.832708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:57.833751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:57.834204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lazy-loading 'fault' on Instance uuid 2ef4043a-5d67-4091-abcb-ed5e596ba355 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 14:59:57.875879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19c0408b4321495eabd4738bbb8b711b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3f79533bbf48018798e6e65050d69c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:57.883285 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-daf74efb-830b-4100-bb98-749390a8950d tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 200 len: 1311 microversion: 2.1 time: 0.098765 Jul 26 14:59:57.883883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 361/701] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:57 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:58.806491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:58.807085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:58.814467 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.814918 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:58.815782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.816274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:58.848824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:58.860292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:58.867119 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.870101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:58.870101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.870101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:58.956639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:58.965441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-aa12cde5-a8c2-4884-8e1f-8f7632ad4beb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.162913 Jul 26 14:59:58.966030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 341/702] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:58 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 14:59:58.983311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:58.983955 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] [instance: 2ef4043a-5d67-4091-abcb-ed5e596ba355] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:58.990220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.990666 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:58.991469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:58.991899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:59.006062 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] HTTP exception thrown: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Request method failure captured: Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 HTTP/1.1 Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-PIfzinAT7j3dv57JccSfrAoVCFVjPpG63tDdFDSnC52c_acC3y6ADqFz9G26qAkZXun6SvpAH2C0ZO-InmiQ04DNJOkLRJcpJbyyIHtF_ueuNI8AIzuWIkxAkgONA_gAYkJcQ9wt_v4sz0kFRjBzbyQ60U6zhA0LHE3brfHBo5ss Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 14:59:59.007750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4f3f79533bbf48018798e6e65050d69c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4f3f79533bbf48018798e6e65050d69c"}]}] Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 4f3f79533bbf48018798e6e65050d69c Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1720921229 Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 19c0408b4321495eabd4738bbb8b711b Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1720921229-project Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. Jul 26 14:59:59.009369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '2ef4043a-5d67-4091-abcb-ed5e596ba355'} Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 14:59:59.010140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. Jul 26 14:59:59.018583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 14:59:59.020130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] Returning 404 to user: Instance 2ef4043a-5d67-4091-abcb-ed5e596ba355 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 14:59:59.020130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cca83c94-5f64-468e-88c5-63fe6ea77073 tempest-ServerRescueNegativeTestJSON-1720921229 tempest-ServerRescueNegativeTestJSON-1720921229-project] 10.222.0.97 "GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355" status: 404 len: 111 microversion: 2.1 time: 0.030336 Jul 26 14:59:59.020130 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 342/703] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:58 2022] GET /compute/v2.1/servers/2ef4043a-5d67-4091-abcb-ed5e596ba355 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 14:59:59.020389 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 14:59:59.020389 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-38336c3c-6130-4539-9b91-ce10e25b7bb3 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1519 microversion: 2.1 time: 0.175080 Jul 26 14:59:59.020575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 362/704] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:58 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 14:59:59.985956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 14:59:59.986706 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 14:59:59.993832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:59.994285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 14:59:59.995062 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 14:59:59.995527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:00.045058 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:00.045667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:00.052594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:00.053050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:00.053840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:00.054287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:00.129914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:00.137772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f2891678-9039-467d-9ede-ededb2b09b4b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.155727 Jul 26 15:00:00.138963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 343/705] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 14:59:59 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:00.186554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:00.194155 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2d94e497-e39d-4d45-ba8f-308e6163175f tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1519 microversion: 2.1 time: 0.153061 Jul 26 15:00:00.194717 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 363/706] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:00 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:00.901079 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-33aac647-0c0a-40c1-bcdd-b30d89d393c0 req-a14d5d33-169b-412f-a100-eb2a4364fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60aed9b-d83f-478b-be96-86d4e4a6ce9c", "name": "network-vif-plugged", "status": "completed", "tag": "df255ca8-fb3a-4312-b426-006fe4958576"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:00.911183 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-33aac647-0c0a-40c1-bcdd-b30d89d393c0 req-a14d5d33-169b-412f-a100-eb2a4364fe3e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:00.911665 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-33aac647-0c0a-40c1-bcdd-b30d89d393c0 req-a14d5d33-169b-412f-a100-eb2a4364fe3e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:00.923309 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-33aac647-0c0a-40c1-bcdd-b30d89d393c0 req-a14d5d33-169b-412f-a100-eb2a4364fe3e service nova] Creating event network-vif-plugged:df255ca8-fb3a-4312-b426-006fe4958576 for instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c on hv-cinder-85103 Jul 26 15:00:00.928607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-33aac647-0c0a-40c1-bcdd-b30d89d393c0 req-a14d5d33-169b-412f-a100-eb2a4364fe3e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031819 Jul 26 15:00:00.929225 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 344/707] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:01.159978 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:01.160630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:01.172953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:01.173406 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:01.174463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:01.174898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:01.216812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:01.223704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:01.224928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:01.225384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:01.226151 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:01.226614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:01.354511 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:01.362868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f932e168-8be7-4fe0-b5fe-2b8065658f86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.207060 Jul 26 15:00:01.363464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 364/708] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:01 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:01.579641 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:01.583285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a0484db4-4cac-4980-940a-24c7894e79ab tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.370624 Jul 26 15:00:01.584103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 345/709] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:01 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:02.386259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:02.386870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:02.393682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:02.394323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:02.395099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:02.395585 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:02.541926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:02.550499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3849fa12-96ac-4d47-bddc-4091dad54f0c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1363 microversion: 2.1 time: 0.168159 Jul 26 15:00:02.551074 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 365/710] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:02 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:02.606122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:02.606786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:02.613904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:02.614428 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:02.615264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:02.615782 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:02.878872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:02.882335 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b23bde39-d375-4023-93b7-a3b108d75862 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.280096 Jul 26 15:00:02.882921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 346/711] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:02 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:03.572542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:03.573253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:03.580617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.581073 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:03.582046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.582637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:03.734191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:03.742108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-65013801-fc85-4691-9d27-e7269aad3d0f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1549 microversion: 2.1 time: 0.173818 Jul 26 15:00:03.742675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 366/712] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:03 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:03.765087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:03.765625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:03.772315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.772770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:03.773813 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.774258 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:03.860128 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f8001588-722c-44cf-be75-4d360eb30b5e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099443 Jul 26 15:00:03.865290 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 347/713] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 15:00:03 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:00:03.903813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:03.904433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:03.910510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.910961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:03.911774 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:03.912212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:04.057617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:04.066361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-33788cb2-9f67-4f0c-baee-9b7e6ae8e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.166273 Jul 26 15:00:04.071896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 367/714] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:03 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:04.987734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-669bbbe7-6d7d-4ddc-89da-80098e6cda8a req-4cc2bdee-fd98-4ee1-bcb0-932ec01aa3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e60aed9b-d83f-478b-be96-86d4e4a6ce9c", "tag": "df255ca8-fb3a-4312-b426-006fe4958576"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:05.000162 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-669bbbe7-6d7d-4ddc-89da-80098e6cda8a req-4cc2bdee-fd98-4ee1-bcb0-932ec01aa3bc service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:05.000833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-669bbbe7-6d7d-4ddc-89da-80098e6cda8a req-4cc2bdee-fd98-4ee1-bcb0-932ec01aa3bc service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:05.012758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-669bbbe7-6d7d-4ddc-89da-80098e6cda8a req-4cc2bdee-fd98-4ee1-bcb0-932ec01aa3bc service nova] Creating event network-changed:df255ca8-fb3a-4312-b426-006fe4958576 for instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c on hv-cinder-85103 Jul 26 15:00:05.018244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-669bbbe7-6d7d-4ddc-89da-80098e6cda8a req-4cc2bdee-fd98-4ee1-bcb0-932ec01aa3bc service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034573 Jul 26 15:00:05.019799 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 348/715] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:05.087998 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:05.089248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:05.097485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:05.098830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:05.099852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:05.101102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:05.262889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:05.273437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a806c4d5-1dd0-4990-bd73-b8c0b117c958 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.188913 Jul 26 15:00:05.275029 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 368/716] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:05 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:06.296931 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:06.297637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:06.304178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:06.304626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:06.305407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:06.305840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:06.445298 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:06.453280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-59a4c3ec-127e-41a4-9461-4b9cb3d17dba tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.160743 Jul 26 15:00:06.453946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 349/717] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:06 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:07.474742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:07.476049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:07.483175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:07.483731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:07.484690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:07.485351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:07.642563 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:07.652237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-72dde4e1-b5ec-49da-aefe-1816105a92eb tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.181411 Jul 26 15:00:07.652929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 369/718] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:07 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:08.674997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:08.675732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:08.684120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:08.684120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:08.684120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:08.684557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:08.853824 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:08.864190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f1175d6c-4fea-4619-9434-568d0b34544e tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.192977 Jul 26 15:00:08.864777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 350/719] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:08 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:09.885927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:09.886680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:09.893556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:09.894010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:09.894785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:09.895222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:10.040710 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:10.046720 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:10.052607 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-94083fe1-107d-40d9-a3fe-9ee53d57e392 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.170408 Jul 26 15:00:10.072105 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 370/720] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:09 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:11.094384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:11.094998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:11.101906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:11.102300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:11.103087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:11.103610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:11.360012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:11.374575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5cdcc2e2-b040-4990-b667-e782e1416094 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.284756 Jul 26 15:00:11.376428 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 351/721] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:11 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:12.397279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:12.397906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:12.405635 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:12.406351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:12.407477 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:12.408098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:12.629739 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:12.646176 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-21052d51-4f87-4c03-b837-25d8c8743d86 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.252794 Jul 26 15:00:12.647195 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 371/722] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:12 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:12.784738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-49fce7e8-5401-43b2-b1fc-d6bee73aef40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: .version_select at 0x7f97e6229550>, body: {"keypair": {"name": "tempest-keypair-122912433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgwYdMMocXRZjlQa5jK9U+9+7aHDcwnJfiRXYY22wngqkwBhXNToKFabaMmLgl5ATQNRC4qnsKB2DljdVlJnr9AlX/MSvIEAxlQie6eJ+shZyIS3gBuj9VZpFc2z6IIgA=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:12.803721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-49fce7e8-5401-43b2-b1fc-d6bee73aef40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for project 7f82b8853b874e61820108bc16e8dc41. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:00:12.809586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-49fce7e8-5401-43b2-b1fc-d6bee73aef40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for user df675a52f9b245198897842f7a6ecd13 and project 7f82b8853b874e61820108bc16e8dc41. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:00:13.027840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-49fce7e8-5401-43b2-b1fc-d6bee73aef40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.487015 Jul 26 15:00:13.030452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 352/723] 10.222.0.97 () {62 vars in 1200 bytes} [Tue Jul 26 15:00:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:00:13.683459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:13.686777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:13.698283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:13.699289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:13.701312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:13.702212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:13.901128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:13.909338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5a7022d6-16fa-4aa6-b4d6-721bf9c6c1b6 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.235228 Jul 26 15:00:13.909916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 372/724] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:13 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:14.936233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:14.940421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:14.951607 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:14.952808 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:14.960205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:14.961301 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:15.213050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:15.233660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4c942d25-61ef-4a1b-a207-312ad4f30fbe tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.305492 Jul 26 15:00:15.260126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 353/725] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:14 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:15.339261 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-22f5be50-4be4-460b-8909-751cec1783be req-8bdd3681-f014-43f7-b5ae-43a36156677c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "name": "network-vif-plugged", "status": "completed", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:15.360778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-22f5be50-4be4-460b-8909-751cec1783be req-8bdd3681-f014-43f7-b5ae-43a36156677c service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:15.361503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-22f5be50-4be4-460b-8909-751cec1783be req-8bdd3681-f014-43f7-b5ae-43a36156677c service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:15.386830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-22f5be50-4be4-460b-8909-751cec1783be req-8bdd3681-f014-43f7-b5ae-43a36156677c service nova] Creating event network-vif-plugged:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 15:00:15.396609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-22f5be50-4be4-460b-8909-751cec1783be req-8bdd3681-f014-43f7-b5ae-43a36156677c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070783 Jul 26 15:00:15.397920 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 373/726] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:00:16.118839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1697580429", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40bf059a-9593-4ce0-be05-c864bfa3c074"}], "security_groups": [{"name": "tempest-securitygroup--1887849426"}], "key_name": "tempest-keypair-122912433", "user_data": "}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:16.250848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] validate_networks() for [('40bf059a-9593-4ce0-be05-c864bfa3c074', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:00:16.275064 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:16.275843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:16.282874 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:16.283331 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:16.284930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:16.285589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:16.438540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:16.454742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cd956d75-acc6-4ae0-953e-83a4d609d767 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.183858 Jul 26 15:00:16.460462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 374/727] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:16 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:00:16.752113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:00:16.752957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:00:16.753835 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:00:16.754578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:00:16.755330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:00:16.771643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:16.772404 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:16.774087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:16.774845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:16.810317 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for project 7f82b8853b874e61820108bc16e8dc41. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:00:16.817971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for user df675a52f9b245198897842f7a6ecd13 and project 7f82b8853b874e61820108bc16e8dc41. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:00:16.837816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:00:16.842789 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:00:17.022583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2f62b4b2-dd44-48ed-88a3-0bc2e36d5acc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.908600 Jul 26 15:00:17.023978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 354/728] 10.222.0.97 () {62 vars in 1188 bytes} [Tue Jul 26 15:00:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 26 15:00:17.036397 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:17.037053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:17.101108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:17.113457 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:17.115782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:17.117272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8e6f004b-406f-41eb-a45a-1c9058a1883d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1281 microversion: 2.20 time: 0.084739 Jul 26 15:00:17.118036 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 375/729] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:17 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:00:17.478992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:17.479875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:17.486695 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:17.487271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:17.488584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:17.489001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:17.647869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:17.655843 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a2bc800c-561d-4889-96ee-3d2607bb99fa tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1575 microversion: 2.1 time: 0.181406 Jul 26 15:00:17.656407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 355/730] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:17 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:00:18.153772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:18.154499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:18.211589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:18.220423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:18.222781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:18.223955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d9d9ce6d-8414-417d-8f92-f817d663fefe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1281 microversion: 2.20 time: 0.077385 Jul 26 15:00:18.224506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 376/731] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:18 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:00:18.677727 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:18.678372 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:18.686434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:18.686915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:18.687753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:18.688190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:18.692658 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:18.819584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:18.827170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-40990b81-96fb-4210-ab35-bdb8966a5f25 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1562 microversion: 2.1 time: 0.153512 Jul 26 15:00:18.827953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 356/732] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:18 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:19.247853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:19.248957 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:19.256095 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:19.256557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:19.257330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:19.257773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:19.327276 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:19.339983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:19.342573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:19.344347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1e388b2b-eeef-4e0b-9512-5fdaf38f2ba5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1333 microversion: 2.20 time: 0.101172 Jul 26 15:00:19.345157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 377/733] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:19 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1333 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:20.369170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:20.370175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:20.378333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:20.378910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:20.379905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:20.380464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:20.462356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:20.475373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:20.477885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:20.479730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8c898260-b6e2-4a07-a89b-ea7e99950c3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1351 microversion: 2.20 time: 0.114930 Jul 26 15:00:20.480924 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 357/734] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:20 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:21.512273 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:21.513014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:21.520034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:21.520584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:21.521470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:21.521975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:21.680757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:21.690431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:21.692011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:21.693135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4168e916-ea1c-46a7-973e-22b385497cbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.184826 Jul 26 15:00:21.693702 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 378/735] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:21 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:22.170227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-dde97041-b6cf-4a9a-a093-b360c0c2ab4b req-9713d1d2-ca83-436e-bac5-836566608a57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:22.188452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-dde97041-b6cf-4a9a-a093-b360c0c2ab4b req-9713d1d2-ca83-436e-bac5-836566608a57 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:22.189591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-dde97041-b6cf-4a9a-a093-b360c0c2ab4b req-9713d1d2-ca83-436e-bac5-836566608a57 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:22.206647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-dde97041-b6cf-4a9a-a093-b360c0c2ab4b req-9713d1d2-ca83-436e-bac5-836566608a57 service nova] Creating event network-changed:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:00:22.212213 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-dde97041-b6cf-4a9a-a093-b360c0c2ab4b req-9713d1d2-ca83-436e-bac5-836566608a57 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049459 Jul 26 15:00:22.212971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 358/736] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:22.717664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:22.718474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:22.726079 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:22.728971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:22.728971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:22.728971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:22.893520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:22.904396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:22.906633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:22.907931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e73371ff-2a3a-4529-a5e0-43fb1d3bad15 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.195251 Jul 26 15:00:22.908817 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 379/737] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:22 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:23.943189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:23.944276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:23.954758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:23.955437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:23.956594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:23.957277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:24.115303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:24.126441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:24.129148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:24.130450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-12999b9c-aa93-40ba-8fc3-6bdf9812b0f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.194074 Jul 26 15:00:24.131187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 359/738] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:23 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:25.155002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:25.155735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:25.158171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=63 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:25.163042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:25.163525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:25.164295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:25.164728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:25.307036 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:25.317528 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:25.319206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:25.320432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d22816ba-0d6c-43fd-aa90-ce480d2ff3d3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.169908 Jul 26 15:00:25.321059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 380/739] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:25 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:00:26.344533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:26.345148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:26.352139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:26.352583 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:26.353350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:26.353783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:26.516662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:26.525538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:26.527285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:26.533229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c7675c71-e43a-42ff-ac5d-4383c29a542e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.188900 Jul 26 15:00:26.533229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 360/740] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:26 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:00:27.554082 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:27.554715 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:27.563771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:27.564556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:27.565762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:27.566417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:27.716018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:27.724993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:27.726534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:27.728204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-99972e23-286c-4dd8-b2e4-c624ad85d59d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.177699 Jul 26 15:00:27.734238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 381/741] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:27 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:28.752545 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:28.753218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:28.755231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.755951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=10 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.757110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:28.762199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:28.762652 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:28.763474 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:28.763946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:28.911158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:28.920190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:28.921748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:28.922857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8366800f-a907-4daf-90d9-94eedbb231a0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.174363 Jul 26 15:00:28.923515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 361/742] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:28 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:29.071420 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-033a3dff-2c70-44ff-bc69-4d3c65c7dc2b req-22f73b9d-0233-446d-98f3-d5b047d19315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "name": "network-vif-plugged", "status": "completed", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:29.077020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:29.083014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-033a3dff-2c70-44ff-bc69-4d3c65c7dc2b req-22f73b9d-0233-446d-98f3-d5b047d19315 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:29.083493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-033a3dff-2c70-44ff-bc69-4d3c65c7dc2b req-22f73b9d-0233-446d-98f3-d5b047d19315 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:29.095781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-033a3dff-2c70-44ff-bc69-4d3c65c7dc2b req-22f73b9d-0233-446d-98f3-d5b047d19315 service nova] Creating event network-vif-plugged:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:00:29.101136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-033a3dff-2c70-44ff-bc69-4d3c65c7dc2b req-22f73b9d-0233-446d-98f3-d5b047d19315 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Jul 26 15:00:29.101778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 382/743] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:29.305671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:29.306170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:29.313407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:29.313864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:29.314654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:29.315092 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:29.341655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d3a1235c-cacf-40bb-b404-cfc2358adf5e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/ips" status: 200 len: 150 microversion: 2.1 time: 0.040147 Jul 26 15:00:29.352433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 362/744] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:00:29 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:29.946041 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:29.946782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:29.953226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:29.953725 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:29.954497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:29.954938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:30.102605 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:30.111800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:30.113374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:30.114507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-aacb5b8d-86ad-4609-9d63-35ef103e772c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.173255 Jul 26 15:00:30.115136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 383/745] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:29 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:31.137187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:31.137899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:31.144860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:31.145310 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:31.146101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:31.146534 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:31.279921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:31.288420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:31.289933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:31.291057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0ffe5ce6-ee1a-45fd-9fa7-06a099cee6cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1407 microversion: 2.20 time: 0.157845 Jul 26 15:00:31.291661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 363/746] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:31 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:00:32.037557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:32.039965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:32.047759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.048208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.048982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.049421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.314382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:32.315261 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:32.321979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.322360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.323144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.323620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.459717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:32.468617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:32.470133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:32.471444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-25eef9ce-fee6-4666-b2a5-e0ae6b448f53 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1597 microversion: 2.20 time: 0.160946 Jul 26 15:00:32.472036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 364/747] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:00:32 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1597 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:00:32.499257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:32.499257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:32.501047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.501524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.502299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:32.502729 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:32.584854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a21dfd6d-12d5-4a3f-a9a5-eab1a686f61f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094754 Jul 26 15:00:32.585453 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 365/748] 10.222.0.97 () {60 vars in 1316 bytes} [Tue Jul 26 15:00:32 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:00:33.011370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d20b34bd-f22d-4e4a-8ae3-17218c87fdf6 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977812 Jul 26 15:00:33.012170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 384/749] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:00:32 2022] POST /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:33.663802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-41594a1c-eb01-410d-8352-7c051e3ee0e7 req-b7d56590-8a3f-418d-a74f-6c630d3ea06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:33.674912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-41594a1c-eb01-410d-8352-7c051e3ee0e7 req-b7d56590-8a3f-418d-a74f-6c630d3ea06f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:33.675530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-41594a1c-eb01-410d-8352-7c051e3ee0e7 req-b7d56590-8a3f-418d-a74f-6c630d3ea06f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:33.690872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-41594a1c-eb01-410d-8352-7c051e3ee0e7 req-b7d56590-8a3f-418d-a74f-6c630d3ea06f service nova] Creating event network-changed:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:00:33.696668 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-41594a1c-eb01-410d-8352-7c051e3ee0e7 req-b7d56590-8a3f-418d-a74f-6c630d3ea06f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037853 Jul 26 15:00:33.697321 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 366/750] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:41.660927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:41.664044 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:41.671987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.672443 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.673288 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.673731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.757575 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: POST /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments HTTP/1.1 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 74 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:00:41.759306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {"volumeAttachment": {"volumeId": "102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44"}} Jul 26 15:00:41.760918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'server_id': '1b3ca784-f197-4dfa-8592-742a8cb0b832', 'body': {'volumeAttachment': {'volumeId': '102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44'}}} Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:00:41.762232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:41.763776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 400 to user: Invalid volume: volume 102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 is already attached to instances: 1b3ca784-f197-4dfa-8592-742a8cb0b832 {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-93c58319-2c2a-42ab-9007-9e6b5e9ae29f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109183 Jul 26 15:00:41.765205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 385/751] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:00:41 2022] POST /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:00:41.830504 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:41.831081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:41.837590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.838035 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.838877 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:41.839311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:41.922883 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lazy-loading 'services' on Instance uuid 1b3ca784-f197-4dfa-8592-742a8cb0b832 {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:00:42.103800 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e5e88196-051a-4cf1-8629-bb6ff1b5cbea tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments/102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44" status: 202 len: 0 microversion: 2.1 time: 0.277987 Jul 26 15:00:42.104500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 367/752] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:00:41 2022] DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments/102a7ff7-d40b-4d0f-b1c2-c3bb2a812a44 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:00:42.112778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:42.114952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:42.122355 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:42.122807 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:42.123639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:42.124082 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:42.154780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fb0cb5ab-3bd4-419e-b0fd-8b46c7b73059 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Jul 26 15:00:42.155355 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 386/753] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:00:42 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:00:43.167427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:43.169881 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:43.176418 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:43.181677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:43.181677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:43.181677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:43.210645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f0afd205-07c0-41a7-b5d0-98641d17375d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Jul 26 15:00:43.211231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 368/754] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:00:43 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:44.224161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:44.226342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:44.232851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.233433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.234191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.234627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.238279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:44.263833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cd455e34-2782-4732-8fa0-360161cd3e33 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043857 Jul 26 15:00:44.264394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 387/755] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:00:44 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:00:44.329650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:44.330153 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:44.336930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.337388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.338160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.338602 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.370794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:00:44.676144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8b4b9643-f4d7-40ef-aaad-e9eee9fcadc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 204 len: 0 microversion: 2.1 time: 0.349941 Jul 26 15:00:44.676669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 369/756] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:00:44 2022] DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:00:44.685639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:44.686271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:44.693088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.693576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.694345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:44.694770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:44.830581 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:44.836219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c6f9d206-3cd0-4134-80f8-384c28f0839a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1682 microversion: 2.1 time: 0.155089 Jul 26 15:00:44.836806 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 388/757] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:44 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:45.860262 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:45.861063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:45.867815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:45.868270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:45.869042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:45.869488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:45.998508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:46.006133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-340b964f-4117-48b2-bb05-5f057f1d5104 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1682 microversion: 2.1 time: 0.150180 Jul 26 15:00:46.006698 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 370/758] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:45 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:47.028048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:47.028664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:47.035601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:47.036051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:47.036827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:47.037314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:47.167141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:47.174925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-51c95ae9-8ab6-4ec2-8b24-205297bd119a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1682 microversion: 2.1 time: 0.150654 Jul 26 15:00:47.175523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 389/759] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:47 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:47.934262 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-6471d41d-91d8-4c76-9ea4-c30a60e880e3 req-b4673c44-76ad-4d9b-b02f-ac7a3bb6ca23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b3ca784-f197-4dfa-8592-742a8cb0b832", "name": "network-vif-deleted", "tag": "9b0e3837-4947-4f14-b8b9-6a4f6f25c7be"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:47.945016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-6471d41d-91d8-4c76-9ea4-c30a60e880e3 req-b4673c44-76ad-4d9b-b02f-ac7a3bb6ca23 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:47.952637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-6471d41d-91d8-4c76-9ea4-c30a60e880e3 req-b4673c44-76ad-4d9b-b02f-ac7a3bb6ca23 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:47.957894 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-6471d41d-91d8-4c76-9ea4-c30a60e880e3 req-b4673c44-76ad-4d9b-b02f-ac7a3bb6ca23 service nova] Creating event network-vif-deleted:9b0e3837-4947-4f14-b8b9-6a4f6f25c7be for instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 on hv-cinder-85103 Jul 26 15:00:47.963112 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-6471d41d-91d8-4c76-9ea4-c30a60e880e3 req-b4673c44-76ad-4d9b-b02f-ac7a3bb6ca23 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032613 Jul 26 15:00:47.963748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 371/760] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:48.197097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:48.197681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:48.205614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.206264 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.207054 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:48.207556 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:48.273966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:48.281942 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7c59fc05-4594-4a6a-a0b8-228a0c03ea39 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 200 len: 1327 microversion: 2.1 time: 0.089549 Jul 26 15:00:48.282513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 390/761] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:48 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:49.305361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:49.305980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:49.312901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:49.313354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:49.314120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:49.314572 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:49.317248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:49.330232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 HTTP/1.1 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:00:49.331902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:00:49.333429 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '1b3ca784-f197-4dfa-8592-742a8cb0b832'} Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:00:49.334407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:00:49.335947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:00:49.337282 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:00:49.337282 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0a5a97a4-0770-46ab-a3d5-e28da541c565 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 404 len: 111 microversion: 2.1 time: 0.032783 Jul 26 15:00:49.337282 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 372/762] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:49 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:00:49.342544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-86c64658-83ff-47ec-92c3-b0783e1b438e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '.version_select at 0x7f97e63d7d30>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:49.453832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-86c64658-83ff-47ec-92c3-b0783e1b438e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476160910" status: 202 len: 0 microversion: 2.1 time: 0.115300 Jul 26 15:00:49.454419 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 391/763] 10.222.0.97 () {58 vars in 1221 bytes} [Tue Jul 26 15:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476160910 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:00:50.258784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-aadbb3d2-31fe-4627-9110-638341120d89 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: .version_select at 0x7f97e629dc10>, body: {"keypair": {"name": "tempest-keypair-311037413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCdb0Y1I0e0SvoQRfgLO3/t8er/N6gfxT2Vaj0H67TbLU2Syw3g+QnM5pMU+Ut41OE9iRSAi7H9MiINHwwL67ATZSxPm/OM5FDiNWheYZLSyozWrP6gHRuLZzCf12PuZw=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:50.275462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-aadbb3d2-31fe-4627-9110-638341120d89 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:00:50.279316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-aadbb3d2-31fe-4627-9110-638341120d89 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:00:50.379483 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-aadbb3d2-31fe-4627-9110-638341120d89 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124434 Jul 26 15:00:50.380142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 373/764] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 15:00:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:53.037654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-619211735", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0"}], "security_groups": [{"name": "tempest-securitygroup--1690289177"}], "key_name": "tempest-keypair-311037413", "user_data": "}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:53.139392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] validate_networks() for [('4d5ed78d-8d76-4adc-bb4a-8f7229cb4df0', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:00:53.511837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:00:53.512268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:00:53.512754 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:00:53.513204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:00:53.513620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:00:53.522515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:53.522971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:53.524079 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:53.524513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:53.541599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:00:53.546125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Getting quotas for user de3b593763e44e28be0f51187defa75d and project ace4455a9e1b44e5bf7b04fd4abf81d7. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:00:53.557222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:00:53.559700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:00:53.728711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-098f9db1-5826-4b28-8c29-3c6a8cb7a856 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697097 Jul 26 15:00:53.729394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 392/765] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:00:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:00:53.741352 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4eeb9bc7-efda-4ce9-b490-2010075dae78 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:53.742030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4eeb9bc7-efda-4ce9-b490-2010075dae78 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:53.804603 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4eeb9bc7-efda-4ce9-b490-2010075dae78 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:53.812117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4eeb9bc7-efda-4ce9-b490-2010075dae78 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1240 microversion: 2.1 time: 0.075584 Jul 26 15:00:53.812728 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 374/766] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:53 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:54.834644 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:54.835245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:54.841847 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:54.842295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:54.843049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:54.843514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:54.909151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:54.917072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1e0b546e-d8a4-4fa1-ac59-7ed248564351 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1244 microversion: 2.1 time: 0.086836 Jul 26 15:00:54.917675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 393/767] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:54 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:55.938547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:55.939292 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:55.946223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:55.946686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:55.947501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:55.947947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:56.026090 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:56.033746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-793908f1-2bfe-4541-a508-3dd8e9d8e30d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1300 microversion: 2.1 time: 0.099138 Jul 26 15:00:56.034345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 375/768] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:55 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:57.056621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:57.057240 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:57.061212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:00:57.065173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:57.065631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:57.066406 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:57.066841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:57.201577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:57.209806 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ced24a7b-189b-419a-a1cb-a49367b22e27 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.157650 Jul 26 15:00:57.210402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 394/769] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:57 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:57.892616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-c5b22209-7ecf-4451-b6ee-a881ee643858 req-0c63556b-5e82-4243-b9d0-f8fc916371c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c85e05-dcac-4e07-a91c-468d6ec28921", "tag": "ae02a5e9-ae0b-4ea7-969c-233ed61c10d5"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:00:57.905476 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-c5b22209-7ecf-4451-b6ee-a881ee643858 req-0c63556b-5e82-4243-b9d0-f8fc916371c3 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:57.905969 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-c5b22209-7ecf-4451-b6ee-a881ee643858 req-0c63556b-5e82-4243-b9d0-f8fc916371c3 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:57.919563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-c5b22209-7ecf-4451-b6ee-a881ee643858 req-0c63556b-5e82-4243-b9d0-f8fc916371c3 service nova] Creating event network-changed:ae02a5e9-ae0b-4ea7-969c-233ed61c10d5 for instance 63c85e05-dcac-4e07-a91c-468d6ec28921 on hv-cinder-85103 Jul 26 15:00:57.925822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-c5b22209-7ecf-4451-b6ee-a881ee643858 req-0c63556b-5e82-4243-b9d0-f8fc916371c3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039603 Jul 26 15:00:57.925822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 376/770] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:00:58.230046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:58.230645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:58.237757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:58.238230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:58.238986 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:58.239447 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:58.372176 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:58.379574 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e16b8ee4-5b41-4120-89fa-ba927ece94be tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.153365 Jul 26 15:00:58.380143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 395/771] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:58 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:00:59.402876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:00:59.403957 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:00:59.410491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:59.410944 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:59.411763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:00:59.412208 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:00:59.547699 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:00:59.555147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a1a950ef-0069-488c-8c95-fb8804d33d2b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.156739 Jul 26 15:00:59.555764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 377/772] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:00:59 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:00.577458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:00.578164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:00.585475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:00.585947 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:00.586900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:00.587424 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:00.720144 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:00.727541 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-564ae875-53e5-4858-8dbb-0a8ec8c4c68b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.155143 Jul 26 15:01:00.728097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 396/773] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:00 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:01:01.748920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:01.749614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:01.752071 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:01.756880 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.757330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.758150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:01.758590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:01.897126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:01.905751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-eae21538-22c5-4d84-8797-7040e56ed579 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.160734 Jul 26 15:01:01.906315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 378/774] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:01 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:02.926344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:02.926964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:02.934088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:02.934542 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:02.935320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:02.935791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:03.071156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:03.078926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d64a02a4-dd04-4e90-9a06-5cdd36cb243f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.156442 Jul 26 15:01:03.079546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 397/775] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:02 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:04.100596 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:04.101200 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:04.103650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=6 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:04.109075 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:04.109523 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:04.110281 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:04.110716 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:04.252790 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:04.260113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-efa029ba-5c21-45ca-b932-80fe126ea72d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.163397 Jul 26 15:01:04.260682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 379/776] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:04 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:05.147553 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-7a5e7a93-9efc-4058-beba-363706d8f068 req-a8a80f34-df1b-4c4d-af62-9abe9573f67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c85e05-dcac-4e07-a91c-468d6ec28921", "name": "network-vif-plugged", "status": "completed", "tag": "ae02a5e9-ae0b-4ea7-969c-233ed61c10d5"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:05.152688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:05.155388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:05.158982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-7a5e7a93-9efc-4058-beba-363706d8f068 req-a8a80f34-df1b-4c4d-af62-9abe9573f67a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:05.159466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-7a5e7a93-9efc-4058-beba-363706d8f068 req-a8a80f34-df1b-4c4d-af62-9abe9573f67a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:05.170586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-7a5e7a93-9efc-4058-beba-363706d8f068 req-a8a80f34-df1b-4c4d-af62-9abe9573f67a service nova] Creating event network-vif-plugged:ae02a5e9-ae0b-4ea7-969c-233ed61c10d5 for instance 63c85e05-dcac-4e07-a91c-468d6ec28921 on hv-cinder-85103 Jul 26 15:01:05.175665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-7a5e7a93-9efc-4058-beba-363706d8f068 req-a8a80f34-df1b-4c4d-af62-9abe9573f67a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031916 Jul 26 15:01:05.176280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 398/777] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:01:05.285946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:05.286570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:05.293557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:05.294170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:05.294869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:05.295310 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:05.437948 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:05.445812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e1bd080f-1011-4663-a48a-4fb93d45222b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.163783 Jul 26 15:01:05.446377 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 380/778] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:05 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:06.469051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:06.469669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:06.476271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:06.476724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:06.477489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:06.477924 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:06.609957 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:06.617300 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-61ca4466-6257-4ff1-a7f2-9256b9f0934e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.153705 Jul 26 15:01:06.617862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 399/779] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:06 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:07.639425 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:07.640102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:07.646566 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:07.647023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:07.647827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:07.648596 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:07.776674 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:07.785081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-53c7b569-5ecb-4f99-907a-71fd1aa09afc tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1366 microversion: 2.1 time: 0.150230 Jul 26 15:01:07.785647 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 381/780] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:07 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:01:08.805156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:08.805800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:08.812894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:08.813345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:08.814110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:08.814550 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:08.942451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:01:08.950040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6705408f-4066-4380-8d94-d805cc090e8f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1557 microversion: 2.1 time: 0.148881 Jul 26 15:01:08.950609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 400/781] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:01:08 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:01:08.970750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:08.971235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:08.977767 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:08.978222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:08.978988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:08.979492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:09.056040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d64c8a93-1d80-4463-a47e-a4631bed6e22 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089071 Jul 26 15:01:09.056671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 382/782] 10.222.0.97 () {58 vars in 1275 bytes} [Tue Jul 26 15:01:08 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:10.098178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-0363e86f-6353-4f5f-81b7-ae7942b4dfe9 req-1d93708e-01ea-4cc7-b82b-85a80689b851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c85e05-dcac-4e07-a91c-468d6ec28921", "tag": "ae02a5e9-ae0b-4ea7-969c-233ed61c10d5"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:10.108796 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0363e86f-6353-4f5f-81b7-ae7942b4dfe9 req-1d93708e-01ea-4cc7-b82b-85a80689b851 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:10.109244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0363e86f-6353-4f5f-81b7-ae7942b4dfe9 req-1d93708e-01ea-4cc7-b82b-85a80689b851 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:10.119971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-0363e86f-6353-4f5f-81b7-ae7942b4dfe9 req-1d93708e-01ea-4cc7-b82b-85a80689b851 service nova] Creating event network-changed:ae02a5e9-ae0b-4ea7-969c-233ed61c10d5 for instance 63c85e05-dcac-4e07-a91c-468d6ec28921 on hv-cinder-85103 Jul 26 15:01:10.125514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-0363e86f-6353-4f5f-81b7-ae7942b4dfe9 req-1d93708e-01ea-4cc7-b82b-85a80689b851 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030943 Jul 26 15:01:10.126112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 401/783] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:34.730551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=9 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:34.732438 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=43 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:34.735784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:34.736276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:34.742263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:34.742772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:34.743663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:34.744612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:34.768653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bf8956e4-567a-47f4-aadd-f358b4c5131b tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039597 Jul 26 15:01:34.769331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 383/784] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:01:34 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:37.675639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=15 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:37.676451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=71 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:37.680870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d632a6-7a33-429c-883c-e5e614a1b6c0"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:37.683927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:37.689977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.693170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:37.693170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:37.693170 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:38.827149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d6726d81-733e-4f05-af68-f999562958a4 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.152894 Jul 26 15:01:38.827859 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 402/785] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:01:37 2022] POST /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:47.415289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:47.418109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:47.425069 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:47.425512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:47.426266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:47.426696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:47.455718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d513bf6c-7f86-4d99-844a-f4f33952bda5 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Jul 26 15:01:47.456326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 384/786] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:01:47 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:47.468454 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:47.469023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:47.475182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:47.475666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:47.476422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:47.476849 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:47.509042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-816ae232-7a80-4548-9be2-58edb88eb1f7 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0" status: 200 len: 194 microversion: 2.1 time: 0.045324 Jul 26 15:01:47.509688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 403/787] 10.222.0.97 () {58 vars in 1413 bytes} [Tue Jul 26 15:01:47 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:50.344469 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff3902fb-e835-4fe2-bee0-a63b70910717"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:50.346780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:50.353913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:50.360631 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:50.360631 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:50.360631 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:51.848348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5c535408-00bb-4e0d-88aa-b1a8ba367dbd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "POST /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.507544 Jul 26 15:01:51.848996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 385/788] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:01:50 2022] POST /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 194 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:01:59.664837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:01:59.665861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:01:59.668507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:59.669169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:01:59.674337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.674785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.675594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.676026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.676485 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-e67d9271-5769-4514-9890-31ff9cdc98a0 req-5cf6dc33-361a-4ecf-bd60-a13ae19c4171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:01:59.686974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e67d9271-5769-4514-9890-31ff9cdc98a0 req-5cf6dc33-361a-4ecf-bd60-a13ae19c4171 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:01:59.687452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e67d9271-5769-4514-9890-31ff9cdc98a0 req-5cf6dc33-361a-4ecf-bd60-a13ae19c4171 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:01:59.699733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-e67d9271-5769-4514-9890-31ff9cdc98a0 req-5cf6dc33-361a-4ecf-bd60-a13ae19c4171 service nova] Creating event network-changed:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 15:01:59.703182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:01:59.705138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-e67d9271-5769-4514-9890-31ff9cdc98a0 req-5cf6dc33-361a-4ecf-bd60-a13ae19c4171 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032974 Jul 26 15:01:59.705750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 386/789] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:00.124125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-41ea3eeb-adf5-455d-a7ee-201e6169e9c1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "DELETE /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 204 len: 0 microversion: 2.1 time: 0.462773 Jul 26 15:02:00.129757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 404/790] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:01:59 2022] DELETE /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:02:00.134667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:00.137138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:00.142109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.142804 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.143627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.144075 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.289291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:00.300090 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f5114fe0-8072-441f-ab5c-2998bfb00c48 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.169611 Jul 26 15:02:00.300714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 387/791] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:00 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:00.448502 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:00.450827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:00.457465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.457918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.458692 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.459133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.490726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5cf02434-2885-4300-9dd2-92e6783bab86 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047013 Jul 26 15:02:00.491295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 405/792] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:00 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:00.640129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:00.640847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:00.646977 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.647555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.648776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.649602 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.680446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-afa9b33b-2bec-4157-8ca5-d48ece5c8f61 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0" status: 200 len: 194 microversion: 2.1 time: 0.044216 Jul 26 15:02:00.681831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 388/793] 10.222.0.97 () {58 vars in 1413 bytes} [Tue Jul 26 15:02:00 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:00.691972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:00.692497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:00.699433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.699890 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.700648 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:00.701093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:00.828023 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'services' on Instance uuid e60aed9b-d83f-478b-be96-86d4e4a6ce9c {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:01.118738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3a3d2427-5c7b-48a6-a089-8ed8f3869ec0 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0" status: 202 len: 0 microversion: 2.1 time: 0.430300 Jul 26 15:02:01.119249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 406/794] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:02:00 2022] DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/26d632a6-7a33-429c-883c-e5e614a1b6c0 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:02:01.323489 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:01.324516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:01.331105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:01.333709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:01.333709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:01.333709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:01.510121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:01.517853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-20014597-8b96-4d19-8a94-effb3b247a89 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1568 microversion: 2.1 time: 0.199636 Jul 26 15:02:01.518626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 389/795] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:01 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:02.541651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:02.542338 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:02.548696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:02.549143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:02.549909 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:02.550374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:02.684219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:02.691911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-20ce23c9-0c8c-4120-95f7-c34dfd800bca tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1450 microversion: 2.1 time: 0.155464 Jul 26 15:02:02.692492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 407/796] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:02 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:03.318601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:03.319097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:03.326392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.326850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.327974 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.328205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.354046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-778347cc-d18f-4903-bfe2-594745802fdc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/ips" status: 200 len: 150 microversion: 2.20 time: 0.039319 Jul 26 15:02:03.354615 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 390/797] 10.222.0.97 () {60 vars in 1289 bytes} [Tue Jul 26 15:02:03 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:02:03.415357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-53f7a8a4-4e57-433a-99cd-0cc25326c4ea req-f2607e48-2aeb-4c8a-abba-c8e2ab8b27c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df55a650-eac7-41dd-8361-bb02fc6d25f6", "name": "network-vif-deleted", "tag": "1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:03.416816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-53f7a8a4-4e57-433a-99cd-0cc25326c4ea req-f2607e48-2aeb-4c8a-abba-c8e2ab8b27c1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.417294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-53f7a8a4-4e57-433a-99cd-0cc25326c4ea req-f2607e48-2aeb-4c8a-abba-c8e2ab8b27c1 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.430453 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-53f7a8a4-4e57-433a-99cd-0cc25326c4ea req-f2607e48-2aeb-4c8a-abba-c8e2ab8b27c1 service nova] Creating event network-vif-deleted:1d4bd2bf-16f8-4aa0-a183-dc45e5c63e42 for instance df55a650-eac7-41dd-8361-bb02fc6d25f6 on hv-cinder-85103 Jul 26 15:02:03.435584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-53f7a8a4-4e57-433a-99cd-0cc25326c4ea req-f2607e48-2aeb-4c8a-abba-c8e2ab8b27c1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032135 Jul 26 15:02:03.438317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 408/798] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:03.714617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:03.715248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:03.721773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.722226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.723315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:03.723781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:03.791975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:03.802787 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9e8577ca-d165-4b25-91ef-d6cbcbb13237 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1220 microversion: 2.1 time: 0.092094 Jul 26 15:02:03.812718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 391/799] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:03 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:04.356839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:04.357437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:04.364206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.364659 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.365435 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.365872 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.396236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d83cddf3-85dc-485c-bd56-752263fbd43f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/ff3902fb-e835-4fe2-bee0-a63b70910717" status: 200 len: 194 microversion: 2.1 time: 0.044802 Jul 26 15:02:04.400035 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 409/800] 10.222.0.97 () {58 vars in 1413 bytes} [Tue Jul 26 15:02:04 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/ff3902fb-e835-4fe2-bee0-a63b70910717 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:04.410093 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:04.410620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:04.417853 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.418311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.419164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.421455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.509539 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'services' on Instance uuid e60aed9b-d83f-478b-be96-86d4e4a6ce9c {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:04.742223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-af05a1a3-a406-486a-b154-e67a49497080 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/ff3902fb-e835-4fe2-bee0-a63b70910717" status: 202 len: 0 microversion: 2.1 time: 0.336090 Jul 26 15:02:04.742732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 392/801] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:02:04 2022] DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments/ff3902fb-e835-4fe2-bee0-a63b70910717 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:02:04.823777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:04.824386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:04.830654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.831110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.831911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.832341 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.863916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:04.864346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:04.864791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lazy-loading 'fault' on Instance uuid df55a650-eac7-41dd-8361-bb02fc6d25f6 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:04.906988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29225fc9f22f4ec7b2979334760fc5ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fde004be36ee4efeaa9ada32b4e2182c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:04.914493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-295d8268-e401-42ea-b223-4610607cbcf1 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 200 len: 1225 microversion: 2.1 time: 0.095208 Jul 26 15:02:04.915722 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 410/802] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:04 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:05.937735 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:05.938472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] [instance: df55a650-eac7-41dd-8361-bb02fc6d25f6] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:05.945172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:05.945667 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:05.946562 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:05.946996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:05.962363 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] HTTP exception thrown: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Request method failure captured: Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 HTTP/1.1 Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4ABhoZRSbSHbjEr6MWegqfe9NTkPsD6VRWRxSOJGhNoPifr5WwDCmsj0E9IklAFrYJKG1qgtzZXbKOvmacHXbalsXeopWuRMfY94O12AjGzDKstmQc4MTleFE7vGDUoKK1imHp1K_XqY6j7-bC3kKN5Fkm8aMvFuBcNTDvi5kHGflnk Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: fde004be36ee4efeaa9ada32b4e2182c Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-TestShelveInstance-1660701150 Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:05.966643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_fde004be36ee4efeaa9ada32b4e2182c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/fde004be36ee4efeaa9ada32b4e2182c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/fde004be36ee4efeaa9ada32b4e2182c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/fde004be36ee4efeaa9ada32b4e2182c"}]}] Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-TestShelveInstance-1660701150 Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: fde004be36ee4efeaa9ada32b4e2182c Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-TestShelveInstance-1660701150 Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-TestShelveInstance-1660701150-project Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 29225fc9f22f4ec7b2979334760fc5ea Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-TestShelveInstance-1660701150-project Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. Jul 26 15:02:05.968345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'df55a650-eac7-41dd-8361-bb02fc6d25f6'} Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:05.969452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. Jul 26 15:02:05.971440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:05.972796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Returning 404 to user: Instance df55a650-eac7-41dd-8361-bb02fc6d25f6 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:05.972796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-407a8344-ecff-45d6-be0c-923c989ef2b8 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6" status: 404 len: 111 microversion: 2.1 time: 0.031896 Jul 26 15:02:05.972796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 393/803] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:05 2022] GET /compute/v2.1/servers/df55a650-eac7-41dd-8361-bb02fc6d25f6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:02:06.216349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cca71e2a-8928-4d03-bd8e-f29541b13714 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] Calling method '.version_select at 0x7f97eabc34c0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:06.321535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cca71e2a-8928-4d03-bd8e-f29541b13714 tempest-TestShelveInstance-1660701150 tempest-TestShelveInstance-1660701150-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1833507386" status: 202 len: 0 microversion: 2.1 time: 0.109007 Jul 26 15:02:06.322028 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 411/804] 10.222.0.97 () {58 vars in 1254 bytes} [Tue Jul 26 15:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1833507386 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:02:06.894375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:06.895515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:06.903192 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:06.903690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:06.915776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:06.915776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:06.934890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lazy-loading 'flavor' on Instance uuid d566308c-cba6-4925-8ac6-820573486d4b {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:06.991045 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:06.993757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.000857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.001326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.002132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.002631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.033299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ba1625be-0c01-4f88-983d-6609081332eb tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046278 Jul 26 15:02:07.033866 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 412/805] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:06 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:02:07.157406 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:07.159547 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.165916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.166364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.167200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.167621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.198207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-87019c9a-7fb3-4398-aa43-7d3946687b20 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045127 Jul 26 15:02:07.201811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 413/806] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:07 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 15:02:07.263560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:07.264217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.270682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.276323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.276323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.276323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.298245 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:02:07.529994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5f833565-cc3b-4983-a511-261f208189b1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/action" status: 202 len: 0 microversion: 2.20 time: 0.642826 Jul 26 15:02:07.533903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 394/807] 10.222.0.97 () {62 vars in 1319 bytes} [Tue Jul 26 15:02:06 2022] POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:02:07.539484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:07.540224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.547171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.547934 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.548726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.549171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.688224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:07.692786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1a84a1f7-f10d-4b17-8799-4108a03cc295 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 204 len: 0 microversion: 2.1 time: 0.431084 Jul 26 15:02:07.693353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 414/808] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:07 2022] DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:02:07.702745 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:07.703515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:07.709195 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:07.710877 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:07.712662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-62da77f5-8f2a-4dd2-affc-6add4efe8aa4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.177537 Jul 26 15:02:07.715533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 395/809] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:07 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:07.716714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.717186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.717963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:07.718396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:07.937497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:07.945468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d15837c8-0758-485d-a6cd-ff9c188ecc69 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1674 microversion: 2.1 time: 0.247298 Jul 26 15:02:07.946580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 415/810] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:07 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1674 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:08.739050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:08.740147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:08.747993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:08.748446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:08.749235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:08.749681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:08.887852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:08.896616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:08.898508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:08.900050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c239991d-177d-4bd2-9120-7d4f8b474463 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.165477 Jul 26 15:02:08.900613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 396/811] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:08 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:08.968535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:08.970027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:08.985666 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:08.986098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:08.986943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:08.987385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:09.158633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:09.166233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a0542d89-f979-4307-8122-fe69066920dd tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1674 microversion: 2.1 time: 0.201989 Jul 26 15:02:09.166837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 416/812] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:08 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:09.931623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:09.931623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:09.932777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:09.933293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:09.934178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:09.934671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:09.954582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:10.188274 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:10.188872 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:10.197326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:10.197777 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:10.198559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:10.198995 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:10.356433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:10.360831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:10.366277 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ce816b59-4a8a-4152-9c84-91fcd6dd6cd1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1674 microversion: 2.1 time: 0.181865 Jul 26 15:02:10.366862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 417/813] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:10 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:10.532320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:10.540919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:10.542441 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:10.543652 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ca312b06-d4bf-467a-af5e-0d4062bddb40 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.623132 Jul 26 15:02:10.544452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 397/814] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:09 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:11.396086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:11.399634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:11.419433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.419433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.419433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.419433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.489726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:11.499466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6035d443-f061-4ca1-bf3c-ce2c47df66ab tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1606 microversion: 2.1 time: 0.114406 Jul 26 15:02:11.500081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 418/815] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:11 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1606 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:11.566492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:11.567105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:11.574062 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.574519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.575303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.575776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.710728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-10a44729-fa8f-47db-80f9-53639aa1b327 req-63560264-f86c-4596-862f-89ff9f8b2fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e60aed9b-d83f-478b-be96-86d4e4a6ce9c", "name": "network-vif-deleted", "tag": "df255ca8-fb3a-4312-b426-006fe4958576"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:11.742290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-10a44729-fa8f-47db-80f9-53639aa1b327 req-63560264-f86c-4596-862f-89ff9f8b2fd4 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:11.743250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-10a44729-fa8f-47db-80f9-53639aa1b327 req-63560264-f86c-4596-862f-89ff9f8b2fd4 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:11.756736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:11.757476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-10a44729-fa8f-47db-80f9-53639aa1b327 req-63560264-f86c-4596-862f-89ff9f8b2fd4 service nova] Creating event network-vif-deleted:df255ca8-fb3a-4312-b426-006fe4958576 for instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c on hv-cinder-85103 Jul 26 15:02:11.769750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:11.769877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-10a44729-fa8f-47db-80f9-53639aa1b327 req-63560264-f86c-4596-862f-89ff9f8b2fd4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062147 Jul 26 15:02:11.770151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 419/816] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:11.770814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:11.772031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b7a01ebe-3a41-4f0d-91dd-afde32bb806c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.209471 Jul 26 15:02:11.772730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 398/817] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:11 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:12.529705 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:12.530166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:12.537057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.537501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.538282 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.538719 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.581473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.582166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.582786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lazy-loading 'fault' on Instance uuid e60aed9b-d83f-478b-be96-86d4e4a6ce9c {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:12.647272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0615d20057342cfbd16aa0ec94d1979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ccd4ff518dc4c37bfb7f343ccc97206', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:12.656780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-86f240ab-614e-4c65-808f-501c9894574e tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 200 len: 1327 microversion: 2.1 time: 0.137099 Jul 26 15:02:12.659096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 420/818] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:12 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:12.797407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:12.799376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:12.809010 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.810048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.811198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:12.811903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:12.994595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:13.003770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:13.005958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:13.007165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1158ccc9-530c-4609-9030-9267e400fe04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.214114 Jul 26 15:02:13.007936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 399/819] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:12 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:13.681790 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:13.682393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:13.689222 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:13.689668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:13.690522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:13.690961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:13.705690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c HTTP/1.1 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:02:13.707335 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:13.708651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'e60aed9b-d83f-478b-be96-86d4e4a6ce9c'} Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:13.709396 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:13.710610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:13.711700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:13.711700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f05f7a3e-6844-4d3f-b709-5005d9d4ba40 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 404 len: 111 microversion: 2.1 time: 0.031460 Jul 26 15:02:13.711700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 421/820] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:13 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:13.717827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-07fbf519-058c-4705-9cbd-697c72b6f06c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '.version_select at 0x7f97e6229e50>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:13.946091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-07fbf519-058c-4705-9cbd-697c72b6f06c tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072286327" status: 202 len: 0 microversion: 2.1 time: 0.230206 Jul 26 15:02:13.946091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 400/821] 10.222.0.97 () {58 vars in 1221 bytes} [Tue Jul 26 15:02:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072286327 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:02:14.032696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:14.035291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:14.041975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:14.042513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:14.043547 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:14.044184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:14.514882 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:14.519120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:14.520824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:14.522130 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-15029ed8-8173-4024-b895-44f430a38cdb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.493686 Jul 26 15:02:14.523328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 422/822] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:14 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:15.546433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:15.547056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:15.554593 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:15.555752 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:15.556550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:15.556998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:15.689455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:15.695339 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:15.697556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:15.698271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a30e9590-b7ca-4fb7-a246-5736f12d3e93 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.155797 Jul 26 15:02:15.699501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 401/823] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:15 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:16.721233 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:16.721839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:16.728438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:16.728889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:16.729658 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:16.730094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:16.874260 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:16.882273 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:16.883805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:16.885114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0474ea14-531b-42a1-84b5-93c3514651fb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.167725 Jul 26 15:02:16.885665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 423/824] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:16 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:17.689264 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:17.689923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:17.692109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:17.696932 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.697364 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.698145 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.698576 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.711953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c HTTP/1.1 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:17.725490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.727749 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'e60aed9b-d83f-478b-be96-86d4e4a6ce9c'} Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:17.728598 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.730087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.731550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:17.731550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-61af1aee-31d4-4adc-aa35-4b40d517fa3f tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 404 len: 111 microversion: 2.1 time: 0.029599 Jul 26 15:02:17.731550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 402/825] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:17 2022] DELETE /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:17.733124 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:17.733822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: e60aed9b-d83f-478b-be96-86d4e4a6ce9c] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:17.740495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.740954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.741722 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.742163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.757944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c HTTP/1.1 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:02:17.759491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.760966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'e60aed9b-d83f-478b-be96-86d4e4a6ce9c'} Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:17.761910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. Jul 26 15:02:17.763388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:17.764815 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance e60aed9b-d83f-478b-be96-86d4e4a6ce9c could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:17.764815 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a2435e07-99dc-4623-9818-f7f16ccadaa3 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c" status: 404 len: 111 microversion: 2.1 time: 0.031718 Jul 26 15:02:17.764815 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 424/826] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:17 2022] GET /compute/v2.1/servers/e60aed9b-d83f-478b-be96-86d4e4a6ce9c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:17.909366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:17.909978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:17.916873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.917323 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:17.918101 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:17.918546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:18.053039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:18.062148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:18.072356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:18.072356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-989c97c5-5aa6-4379-9296-c1276b74bc52 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.159988 Jul 26 15:02:18.072356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 403/827] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:17 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:19.089545 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:19.090159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:19.096731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.097189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.097958 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.098400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.202017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:19.202560 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:19.209417 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.209875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.210671 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.211831 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.225615 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d HTTP/1.1 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:19.227194 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.228599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'd1552ebb-d614-4398-96ba-47e3fd737e3d'} Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:19.229315 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.230512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.239917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:19.239917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-48cbe74a-d79c-4043-9e65-7f8bff7b2fe1 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 404 len: 111 microversion: 2.1 time: 0.030940 Jul 26 15:02:19.239917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 404/828] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:19 2022] DELETE /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:02:19.240173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:19.240294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:19.240294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] [instance: d1552ebb-d614-4398-96ba-47e3fd737e3d] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:19.240474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:19.240474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:19.240946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-49dd422a-33d6-4946-a202-4102c5c33ee0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.156013 Jul 26 15:02:19.241493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 425/829] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:19 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:19.243933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.244392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.245172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:19.245614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:19.259612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] HTTP exception thrown: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Request method failure captured: Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d HTTP/1.1 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-NCs_7lvBI9zD7oJrWU8xCjrXKUu6kQJdqrJKFcd5S0smZkEDc9CN1o2GYFZC1X30WizNmN3ECG802o9dKILaA5IJAyeIc82TcLgefPxqAc5ZO6jpt-4igBWQR1ihDS8N0IS-JRpcD6x0XliBHe5TyO1cfSLC_daj8QqAVcveGztk Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:19.261165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7ccd4ff518dc4c37bfb7f343ccc97206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7ccd4ff518dc4c37bfb7f343ccc97206"}]}] Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7ccd4ff518dc4c37bfb7f343ccc97206 Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeTestJSON-766450646 Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: e0615d20057342cfbd16aa0ec94d1979 Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeTestJSON-766450646-project Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.262661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'd1552ebb-d614-4398-96ba-47e3fd737e3d'} Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:19.263601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. Jul 26 15:02:19.265106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:19.266382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] Returning 404 to user: Instance d1552ebb-d614-4398-96ba-47e3fd737e3d could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:19.266382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0143ff37-d38e-4ced-b61c-52c9c90b8420 tempest-AttachVolumeTestJSON-766450646 tempest-AttachVolumeTestJSON-766450646-project] 10.222.0.97 "GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d" status: 404 len: 111 microversion: 2.1 time: 0.029165 Jul 26 15:02:19.266382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 405/830] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:19 2022] GET /compute/v2.1/servers/d1552ebb-d614-4398-96ba-47e3fd737e3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:02:20.264596 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:20.265205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:20.272000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:20.272385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:20.273423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:20.273879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:20.407897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:20.418841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:20.420480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:20.421698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-34999865-61b4-4e1d-b943-e1854a01ddd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.161023 Jul 26 15:02:20.422253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 426/831] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:20 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:21.445682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:21.453170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:21.456431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:21.456865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:21.457887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:21.466116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:21.630856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:21.637475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:21.638975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:21.640159 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e5b2e365-51be-428d-a832-6f3c04f9178a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1743 microversion: 2.20 time: 0.199147 Jul 26 15:02:21.640771 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 406/832] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:21 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:22.665308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:22.665972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:22.673498 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:22.674270 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:22.675344 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:22.675961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:22.904842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:22.914464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:22.916320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:22.918561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6cfd533f-a1af-4eb5-ae14-014866b87960 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1743 microversion: 2.20 time: 0.257991 Jul 26 15:02:22.919446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 427/833] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:22 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:23.506802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-12b69661-195d-4141-a963-06ee691ac44e req-9f0bbb1d-70d8-45ed-8662-19f09a3f15f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "name": "network-vif-plugged", "status": "completed", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:23.518046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-12b69661-195d-4141-a963-06ee691ac44e req-9f0bbb1d-70d8-45ed-8662-19f09a3f15f8 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:23.518389 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-12b69661-195d-4141-a963-06ee691ac44e req-9f0bbb1d-70d8-45ed-8662-19f09a3f15f8 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:23.530965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-12b69661-195d-4141-a963-06ee691ac44e req-9f0bbb1d-70d8-45ed-8662-19f09a3f15f8 service nova] Creating event network-vif-plugged:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:02:23.537199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-12b69661-195d-4141-a963-06ee691ac44e req-9f0bbb1d-70d8-45ed-8662-19f09a3f15f8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034088 Jul 26 15:02:23.538308 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 407/834] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:23.945175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:23.945813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:23.952999 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:23.953455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:23.959096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:23.959096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:24.086967 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:24.096108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:24.097622 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:24.098827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b867fd1a-066c-481e-a395-1a3031f34baf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1743 microversion: 2.20 time: 0.157883 Jul 26 15:02:24.099689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 428/835] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:23 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:25.122677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:25.123375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:25.130430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:25.130885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:25.131679 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:25.132119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:25.265609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:25.274519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:25.276049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:25.277253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-faf03b04-902d-4478-87bc-70b11722a112 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1743 microversion: 2.20 time: 0.158777 Jul 26 15:02:25.277808 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 408/836] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:25 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:25.812753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-474dfa09-ebe7-4201-8ff7-e5cc61fb84e8 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Action: 'create', calling method: .version_select at 0x7f97eab15160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1130657760", "metadata": {"Type": "work"}}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-474dfa09-ebe7-4201-8ff7-e5cc61fb84e8 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 122 Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:02:25.821198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1130657760", "metadata": {"Type": "work"}}} Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: Jul 26 15:02:25.822753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1130657760', 'metadata': {'Type': 'work'}}}} Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:25.823951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:02:25.825523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:02:25.826753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 15:02:25.826753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.826753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-474dfa09-ebe7-4201-8ff7-e5cc61fb84e8 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:25.826753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-474dfa09-ebe7-4201-8ff7-e5cc61fb84e8 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.128436 Jul 26 15:02:25.826753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 429/837] 10.222.0.97 () {60 vars in 1156 bytes} [Tue Jul 26 15:02:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:02:25.832764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ee9bd464-629e-450b-a443-f87c953b999d tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Action: 'create', calling method: .version_select at 0x7f97e618adc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1267417163", "metadata": {"Type": "work"}}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ee9bd464-629e-450b-a443-f87c953b999d tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 120 Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:25.837538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1267417163", "metadata": {"Type": "work"}}} Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 15:02:25.848293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1267417163', 'metadata': {'Type': 'work'}}}} Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi '0' Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:25.849226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:02:25.851114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:02:25.853055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 15:02:25.853055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.853055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ee9bd464-629e-450b-a443-f87c953b999d tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:25.853055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ee9bd464-629e-450b-a443-f87c953b999d tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010390 Jul 26 15:02:25.853055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 409/838] 10.222.0.97 () {60 vars in 1156 bytes} [Tue Jul 26 15:02:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:02:25.855156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-799124c5-a945-4b6f-84c6-4598af34a266 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Action: 'create', calling method: .version_select at 0x7f97eab489d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-221176637", "metadata": {"Type": "work"}}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-799124c5-a945-4b6f-84c6-4598af34a266 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 118 Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:02:25.859623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-221176637", "metadata": {"Type": "work"}}} Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: Jul 26 15:02:25.861136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-221176637', 'metadata': {'Type': 'work'}}}} Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise error Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi '' Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:25.862117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 15:02:25.863908 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 15:02:25.865436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 15:02:25.865436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.865436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-799124c5-a945-4b6f-84c6-4598af34a266 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:25.865436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-799124c5-a945-4b6f-84c6-4598af34a266 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010269 Jul 26 15:02:25.865436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 430/839] 10.222.0.97 () {60 vars in 1156 bytes} [Tue Jul 26 15:02:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:02:25.871168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-453696e8-9723-43b3-aac8-9e3f6ec8acf4 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Calling method '.version_select at 0x7f97e629d280>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:25.898754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-453696e8-9723-43b3-aac8-9e3f6ec8acf4 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] HTTP exception thrown: Volume tempest-invalid-2016597406 could not be found. Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-453696e8-9723-43b3-aac8-9e3f6ec8acf4 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2016597406 HTTP/1.1 Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:25.901558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Volume tempest-invalid-2016597406 could not be found. Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'tempest-invalid-2016597406'} Jul 26 15:02:25.903147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2016597406 could not be found. (HTTP 404) (Request-ID: req-5e161042-156b-4d22-9ba3-4233b43aba7b) Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.904110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:02:25.905530 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2016597406 could not be found. Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:25.916168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2016597406 could not be found. Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2016597406 could not be found. Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-453696e8-9723-43b3-aac8-9e3f6ec8acf4 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 404 to user: Volume tempest-invalid-2016597406 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-453696e8-9723-43b3-aac8-9e3f6ec8acf4 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2016597406" status: 404 len: 99 microversion: 2.1 time: 0.036253 Jul 26 15:02:25.917551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 410/840] 10.222.0.97 () {58 vars in 1218 bytes} [Tue Jul 26 15:02:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2016597406 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 26 15:02:25.924131 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7a6c06aa-0771-459f-a37f-0906bdb17a78 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003894 Jul 26 15:02:25.924993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 431/841] 10.222.0.97 () {58 vars in 1140 bytes} [Tue Jul 26 15:02:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 15:02:25.934416 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-133550c7-7425-450d-8d25-c038984a17ab tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003790 Jul 26 15:02:25.934943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 411/842] 10.222.0.97 () {58 vars in 1137 bytes} [Tue Jul 26 15:02:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 15:02:25.947423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daec9ca7-cd92-4623-a683-1e4a537d262e tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Calling method '.version_select at 0x7f97eab0daf0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:25.974621 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-daec9ca7-cd92-4623-a683-1e4a537d262e tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] HTTP exception thrown: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daec9ca7-cd92-4623-a683-1e4a537d262e tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: DELETE /compute/v2.1/os-volumes/89d308de-1ca9-4b86-8dcc-41edffa2fb73 HTTP/1.1 Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:02:25.978428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '89d308de-1ca9-4b86-8dcc-41edffa2fb73'} Jul 26 15:02:25.979988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. (HTTP 404) (Request-ID: req-2c38ef4f-86b9-4154-b231-9d3df3722c63) Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.980803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:02:25.982047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:02:25.983456 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daec9ca7-cd92-4623-a683-1e4a537d262e tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 404 to user: Volume 89d308de-1ca9-4b86-8dcc-41edffa2fb73 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-daec9ca7-cd92-4623-a683-1e4a537d262e tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/89d308de-1ca9-4b86-8dcc-41edffa2fb73" status: 404 len: 109 microversion: 2.1 time: 0.036210 Jul 26 15:02:25.984965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 432/843] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:02:25 2022] DELETE /compute/v2.1/os-volumes/89d308de-1ca9-4b86-8dcc-41edffa2fb73 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:25.989682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b9527124-b500-4de5-87d8-6df28914a9a7 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Calling method '.version_select at 0x7f97e618aa60>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:26.017724 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-b9527124-b500-4de5-87d8-6df28914a9a7 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] HTTP exception thrown: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b9527124-b500-4de5-87d8-6df28914a9a7 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Request method failure captured: Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/os-volumes/743f2722-8daa-40bc-89d3-9a314f68a371 HTTP/1.1 Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AIBrqwv0mr2a3yTyjavhc_R6L0wzBzyN9xvBEyT8wiFfjbuuzIHilWc8sWPEijfGTlK2VdxAsdIVCT2fCjDCYZMwc9hCBG90Py_05SHufe_C36-eMqZWau1f0-qlfnokHr8naVLBOknK-4e27hdguJ3945ISxBPyxE02Jp8t4pGMbc Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:02:26.019718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/0c3dc09e6feb437f880edefe2a72d04e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/0c3dc09e6feb437f880edefe2a72d04e"}]}] Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 0c3dc09e6feb437f880edefe2a72d04e Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesNegativeTest-550454099 Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 34a9408ca7b44cd2a585544851faa4d9 Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesNegativeTest-550454099-project Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '743f2722-8daa-40bc-89d3-9a314f68a371'} Jul 26 15:02:26.021227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. (HTTP 404) (Request-ID: req-d8f6caa4-81e4-4e93-b791-007ad593687f) Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:26.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:02:26.024003 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:02:26.025273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b9527124-b500-4de5-87d8-6df28914a9a7 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] Returning 404 to user: Volume 743f2722-8daa-40bc-89d3-9a314f68a371 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b9527124-b500-4de5-87d8-6df28914a9a7 tempest-VolumesNegativeTest-550454099 tempest-VolumesNegativeTest-550454099-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/743f2722-8daa-40bc-89d3-9a314f68a371" status: 404 len: 109 microversion: 2.1 time: 0.035401 Jul 26 15:02:26.026600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 412/844] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:02:25 2022] GET /compute/v2.1/os-volumes/743f2722-8daa-40bc-89d3-9a314f68a371 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:02:26.300487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:26.301102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:26.307944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:26.308452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:26.309228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:26.309663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:26.444723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:26.453340 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:26.454898 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:26.456101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-314c915d-3ade-49e0-897b-7e5f2de28ff2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1743 microversion: 2.20 time: 0.160310 Jul 26 15:02:26.456652 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 433/845] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:26 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:27.481181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:27.482426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:27.488197 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:27.488645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:27.489421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:27.489862 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:27.628639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:27.636753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:27.638289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:27.639461 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e2ce83fe-d330-46b0-b2de-987d470754b8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.163690 Jul 26 15:02:27.640017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 413/846] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:27 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:28.662760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:28.664010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:28.672024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:28.672935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:28.674028 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:28.674530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:28.861634 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:28.872744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:28.875748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:28.878984 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-67e55abf-042d-4315-81d5-c9fd73eadf4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.220608 Jul 26 15:02:28.895894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 434/847] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:28 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:29.903084 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:29.906365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:29.912972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:29.914227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:29.915342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:29.915978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:30.084758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:30.093527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:30.095226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:30.096681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6fbd95d7-e837-44aa-83ff-2aaed910956d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.198254 Jul 26 15:02:30.111995 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 414/848] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:29 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:31.122451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:31.123125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:31.125552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:31.137014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:31.137470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:31.138402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:31.138883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:31.278955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:31.286966 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:31.288527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:31.289695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b3302153-6a87-4376-b6ab-700af2336437 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.172096 Jul 26 15:02:31.290263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 435/849] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:31 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:32.314123 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:32.314673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:32.322000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:32.322804 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:32.324201 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:32.324802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:32.512260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:32.521643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:32.524008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:32.525766 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0adf34e2-9522-4dd3-96b5-95a136f5324e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.216571 Jul 26 15:02:32.540039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 415/850] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:32 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:33.550669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:33.551328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:33.559868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:33.560373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:33.561140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:33.561576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:33.714711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:33.723616 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:33.725506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:33.727132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9163920e-ee19-4888-8e4a-e60682a87749 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.180355 Jul 26 15:02:33.743431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 436/851] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:33 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:34.752634 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:34.753277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:34.759913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.760364 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.761135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:34.761582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:34.912439 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:34.920978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:34.922480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:34.923665 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5e21fa30-fba7-44c4-b6dd-4e10cf42305a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.174918 Jul 26 15:02:34.924254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 416/852] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:34 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:35.947018 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:35.947711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:35.956111 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:35.956568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:35.957964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:35.958402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:36.098366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:36.107941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:36.111520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:36.111520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1e95cf72-1205-4fdf-9704-f29f7e90ee56 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.168641 Jul 26 15:02:36.114403 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 437/853] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:35 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:37.134772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:37.135378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:37.142542 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:37.143012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:37.143837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:37.144479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:37.303773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:37.317956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:37.320458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:37.321840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6e7e8624-c547-468b-9ebb-4cb35f6493a4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.190978 Jul 26 15:02:37.322524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 417/854] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:37 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:38.347970 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:38.349792 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:38.365804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.366353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.367316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:38.367832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:38.521445 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:38.530840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:38.532475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:38.533894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4c92c0f1-6217-4078-8012-140e15f505c9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.190829 Jul 26 15:02:38.534291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 438/855] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:38 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:39.558104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:39.558716 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:39.565415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:39.565866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:39.566643 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:39.567084 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:39.677443 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:39.678133 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:39.685509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:39.685956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:39.686723 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:39.687153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:39.708168 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:39.714166 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:39.715715 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:39.716896 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-83a5faca-3a52-4d3d-9f4e-be1ff8b363c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.163383 Jul 26 15:02:39.717461 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 418/856] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:39 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:39.727953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-999ab9a1-9b0f-4b1f-abe8-3606e0bd5850 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/ips" status: 200 len: 150 microversion: 2.1 time: 0.054999 Jul 26 15:02:39.728752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 439/857] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:02:39 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:02:40.745491 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:40.747104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:40.755103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:40.755994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:40.757807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:40.758548 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:40.771983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=83 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:40.907600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:40.916188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:40.924605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:40.925765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f4075d5f-c2a2-4239-ad69-2bc056271d8c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.187645 Jul 26 15:02:40.926321 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 419/858] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:40 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:41.949315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:41.949926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:41.962899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:41.963354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:41.964158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:41.964597 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:41.967312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=97 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:42.100840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:42.108859 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:42.110377 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:42.111586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9d96d4ce-b575-424f-b017-f2f50607ee4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1738 microversion: 2.20 time: 0.166369 Jul 26 15:02:42.112143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 440/859] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:41 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:42.860446 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc1300f1-3998-4884-896b-40dbc5193bb9"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:42.863017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:42.872346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:42.872799 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:42.873581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:42.874020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:43.134383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:43.135002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:43.143361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:43.143835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:43.144653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:43.145120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:43.323104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:43.323104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:43.323363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:43.323363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fba124c6-ef83-4b3f-b071-ba9f79b873a2 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1720 microversion: 2.20 time: 0.190103 Jul 26 15:02:43.323363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 441/860] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:43 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:43.875697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1d32595d-24b2-4bfb-acd7-31f24cc78b30 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "POST /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.019405 Jul 26 15:02:43.876242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 420/861] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:02:42 2022] POST /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:44.352200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:44.352888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:44.359749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:44.360272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:44.361117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:44.361627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:44.654324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:44.663510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:44.665038 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:44.666199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-601cdeff-8822-4ea8-86d6-b26af3862a7e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1720 microversion: 2.20 time: 0.317979 Jul 26 15:02:44.666760 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 442/862] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:44 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1720 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:45.605253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-13105760-a4b6-46f0-a3d3-a7e3108d13c3 req-6e58cb68-eae9-4dd6-8ea3-64086492de4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "name": "network-vif-unplugged", "status": "completed", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:45.615366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-13105760-a4b6-46f0-a3d3-a7e3108d13c3 req-6e58cb68-eae9-4dd6-8ea3-64086492de4b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:45.615905 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-13105760-a4b6-46f0-a3d3-a7e3108d13c3 req-6e58cb68-eae9-4dd6-8ea3-64086492de4b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:45.628318 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-13105760-a4b6-46f0-a3d3-a7e3108d13c3 req-6e58cb68-eae9-4dd6-8ea3-64086492de4b service nova] Creating event network-vif-unplugged:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:02:45.633190 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-13105760-a4b6-46f0-a3d3-a7e3108d13c3 req-6e58cb68-eae9-4dd6-8ea3-64086492de4b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033340 Jul 26 15:02:45.633783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 421/863] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:45.689813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:45.690421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:45.697147 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:45.697637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:45.698408 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:45.698982 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:45.832003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:45.844538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:45.848704 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:45.848704 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e0cc0aa4-97fd-4b53-a5b4-2d94f5e5f796 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1720 microversion: 2.20 time: 0.161554 Jul 26 15:02:45.848704 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 443/864] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:45 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:46.874349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:46.875052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:46.881410 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:46.882498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:46.883274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:46.883880 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:47.016765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:47.025159 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:47.026680 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:47.027897 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ef5ef265-0d40-4952-9a25-fe34dc82fa27 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1663 microversion: 2.20 time: 0.159781 Jul 26 15:02:47.028657 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 422/865] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:46 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:47.059525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec515a3e-2adf-4e46-bfaa-952a81016341"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:47.062016 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:47.069195 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:47.069614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:47.070389 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:47.070845 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:48.532483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5d94a2d8-71ff-4d92-a3d9-0b3ee2c3c56d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.477555 Jul 26 15:02:48.532483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 444/866] 10.222.0.97 () {62 vars in 1364 bytes} [Tue Jul 26 15:02:47 2022] POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments => generated 188 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 15:02:48.664773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:48.665506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:48.672150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:48.672605 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:48.673411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:48.673856 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.004415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-14255b02-81de-48a0-bab9-0116284625c0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/action" status: 202 len: 0 microversion: 2.20 time: 0.344100 Jul 26 15:02:49.014464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 423/867] 10.222.0.97 () {62 vars in 1319 bytes} [Tue Jul 26 15:02:48 2022] POST /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:02:49.014627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:49.014746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:49.021042 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.021491 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.022277 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:49.022955 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:49.168513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:49.177951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:49.180178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:49.181607 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0c7b83aa-60c0-46ae-be16-d97d60e925f3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1749 microversion: 2.20 time: 0.171573 Jul 26 15:02:49.182164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 445/868] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:49 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:50.206602 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:50.207356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:50.210060 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=38 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:50.215066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:50.215488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:50.216279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:50.216720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:50.359196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:50.372500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:50.374056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:50.375286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8591c26c-3210-4e5c-829f-fe5ba8c34186 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1749 microversion: 2.20 time: 0.174364 Jul 26 15:02:50.375866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 424/869] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:50 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:51.401368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:51.403291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:51.410560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:51.411607 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:51.412401 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:51.413376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:51.557496 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:51.569290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:51.571691 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:51.574837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b10d5e1d-8dd7-4f58-9b11-5b7a6bedb1a7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1751 microversion: 2.20 time: 0.178578 Jul 26 15:02:51.575422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 446/870] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:51 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:52.598454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:52.599063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:52.608080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:52.609347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:52.609347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:52.609708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:52.747411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:52.756034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:52.758147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:52.759305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-72ca7cd0-b5f8-4a3d-8d37-5e909d7745e0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1751 microversion: 2.20 time: 0.165020 Jul 26 15:02:52.759902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 425/871] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:52 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:53.665595 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:53.666603 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:53.672731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.673189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.674013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.675137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.756342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lazy-loading 'services' on Instance uuid 63c85e05-dcac-4e07-a91c-468d6ec28921 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:02:53.782116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:53.782725 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:53.790076 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.794745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.794745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:53.794745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:53.928103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:53.938465 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:53.938841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:53.940032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-afced096-3934-4208-b6d0-ce8191e1fb61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1751 microversion: 2.20 time: 0.161792 Jul 26 15:02:53.940577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 426/872] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:53 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:54.055624 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-04667cd4-3a6b-4b42-9e80-f4950bb139da tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments/cc1300f1-3998-4884-896b-40dbc5193bb9" status: 202 len: 0 microversion: 2.1 time: 0.394299 Jul 26 15:02:54.056219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 447/873] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:02:53 2022] DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments/cc1300f1-3998-4884-896b-40dbc5193bb9 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:02:54.065542 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:54.067870 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:54.074311 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.075014 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.075834 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.076274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.107886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d1a00d21-11f2-4de0-a2ec-14b5fb8db35e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047121 Jul 26 15:02:54.108442 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 427/874] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:54 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:54.555997 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1548753527", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "networks": [{"uuid": "b73b63f9-386d-4870-ba80-b40f9d9a2c7e"}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:02:54.609209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] validate_networks() for [('b73b63f9-386d-4870-ba80-b40f9d9a2c7e', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:02:54.962997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:54.963748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:54.970349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.970950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.971613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.972057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.975025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:02:54.976823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:02:54.977197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:02:54.977959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:02:54.978851 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:02:54.988271 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.988714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:54.989503 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:54.989937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.007609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Getting quotas for project ba1773de981b41bd829bc90d92f2f649. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:02:55.011609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Getting quotas for user 39d959e5dbd346708e87b496d344af28 and project ba1773de981b41bd829bc90d92f2f649. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:02:55.022523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:02:55.025438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:02:55.105648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:55.119983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:55.119983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:55.119983 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ec773160-da66-4ef1-b9c6-9d67bccec728 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1751 microversion: 2.20 time: 0.159774 Jul 26 15:02:55.120312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 428/875] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:54 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:55.124106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:55.126226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:55.132244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:55.132713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.133481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:55.133917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:55.163251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-71c99e47-b124-4e2d-9b31-46088699825b tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042292 Jul 26 15:02:55.163852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 429/876] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:55 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:02:55.235862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dd7eaa81-ea11-408b-b122-77ab885d5168 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684864 Jul 26 15:02:55.236518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 448/877] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:02:55.247348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2284880c-f703-446b-a2e9-2462dd9d0ac5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:55.247964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2284880c-f703-446b-a2e9-2462dd9d0ac5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:55.306841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2284880c-f703-446b-a2e9-2462dd9d0ac5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:55.313686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2284880c-f703-446b-a2e9-2462dd9d0ac5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1214 microversion: 2.1 time: 0.070268 Jul 26 15:02:55.314260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 430/878] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:55 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:56.141862 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.142593 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.154027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.154749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.155565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.156221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.175079 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.177389 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.188086 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.188537 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.189359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.197263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.250055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0efabac2-db5a-4f36-8ac5-184bbe19e68d tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078552 Jul 26 15:02:56.250659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 431/879] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:02:56 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:02:56.325458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:56.325458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:56.325703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:56.325962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-917adaee-fb43-4f2d-b706-65eb871703ef tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.187618 Jul 26 15:02:56.326766 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 449/880] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:56 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:56.332739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.333237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.336126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-21d10973-268d-43bd-b657-613210b9979b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.336906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-21d10973-268d-43bd-b657-613210b9979b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.345939 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.346390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.347330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.347923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.376584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:02:56.393487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-21d10973-268d-43bd-b657-613210b9979b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:56.402048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-21d10973-268d-43bd-b657-613210b9979b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1214 microversion: 2.1 time: 0.070346 Jul 26 15:02:56.411597 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 450/881] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:56 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:56.786565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bce32277-0d0a-4cc0-925f-73531c763a1a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 204 len: 0 microversion: 2.1 time: 0.458033 Jul 26 15:02:56.787963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 432/882] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:02:56 2022] DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 15:02:56.796902 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:56.797574 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:56.804676 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.805137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.805964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:56.806410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:56.938558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:56.946682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-54d8143e-5805-43cc-a61c-cdd8b6082771 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.153798 Jul 26 15:02:56.947250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 451/883] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:56 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:57.353263 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.353879 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.360456 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.360914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.361685 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.362129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.377617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:57.424086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.424749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.432110 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.440135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.440135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.440135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.496436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.497353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.504283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-277dfee1-10dc-412a-bb7c-189f08d3a8e8 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1218 microversion: 2.1 time: 0.084049 Jul 26 15:02:57.504930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 452/884] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:02:57.505925 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.507566 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:57.508738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-fff769c0-9ad9-4bec-a94d-d2d9d505d224 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.160468 Jul 26 15:02:57.509289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 433/885] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:02:57.969007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:57.969617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:57.975686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.976136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:57.976929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:57.977369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.112876 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:58.121108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dfd87cb1-dbf0-4058-80d0-4c76e7c424c9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.155965 Jul 26 15:02:58.121667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 453/886] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:57 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:58.525978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:58.526589 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:58.533635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.534095 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.539594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.539594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.539855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:58.539855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:58.543488 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.543935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.544744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:58.545231 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:58.608154 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:58.625272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e846781a-12f1-467c-809e-32887626b003 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1210 microversion: 2.1 time: 0.097283 Jul 26 15:02:58.625272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 434/887] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:58 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:58.731565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:58.741976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:58.743436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:58.744852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3787700a-db34-4ec1-9f47-0134cc1f6457 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.213255 Jul 26 15:02:58.760205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 454/888] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:58 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:02:59.142485 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:59.143518 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:59.150928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.151753 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.152253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.152746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.297440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.305566 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-dd1b9fd6-01a4-4eb5-a03c-4091d807b08c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.167182 Jul 26 15:02:59.306070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 435/889] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:59 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:59.646429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:59.646429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:59.648153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.648667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.649470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.649906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.653090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:02:59.730317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.739562 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ea4504b1-6137-4819-bbf4-241350c71d48 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.102894 Jul 26 15:02:59.740178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 455/890] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:02:59 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:02:59.768829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:02:59.769437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:02:59.776316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.776770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.777534 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:02:59.778089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:02:59.926021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.935256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.936816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:02:59.937987 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-620001b5-290e-428f-afa7-2ce0cf0bfaaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.173116 Jul 26 15:02:59.938555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 436/891] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:02:59 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:00.327975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:00.328593 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:00.335369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.336015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.336661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.337069 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.481357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:00.484642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a3e10e60-fe4c-4ca1-9cf9-b520cd12daf7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.160495 Jul 26 15:03:00.485737 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 456/892] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:00 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:00.762345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:00.763235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:00.769730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.770458 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.770937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.771422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.837477 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:00.848659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-502d830b-d401-40eb-a3a2-8551e70f89b3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.090901 Jul 26 15:03:00.855516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 437/893] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:00 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:00.964284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:00.964284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:00.970615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.971137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:00.971927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:00.972372 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.109927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.118870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.120462 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.121641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d5560455-491e-4f94-957d-8947c0df1088 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.162710 Jul 26 15:03:01.122186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 457/894] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:00 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:01.508692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:01.509283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:01.515489 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.515960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.516781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.517243 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.682420 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-2aa7314c-7631-47f9-9ece-c0bdef6c5fa8 req-277886cd-8e22-415a-b4bc-f50ed5b20e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c85e05-dcac-4e07-a91c-468d6ec28921", "name": "network-vif-unplugged", "status": "completed", "tag": "ae02a5e9-ae0b-4ea7-969c-233ed61c10d5"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:01.691291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.692788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-2aa7314c-7631-47f9-9ece-c0bdef6c5fa8 req-277886cd-8e22-415a-b4bc-f50ed5b20e06 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.693268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-2aa7314c-7631-47f9-9ece-c0bdef6c5fa8 req-277886cd-8e22-415a-b4bc-f50ed5b20e06 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.700152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-616831f5-e55f-49bc-af74-6f656cd69210 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.196160 Jul 26 15:03:01.700955 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 438/895] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:01 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:01.706833 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-2aa7314c-7631-47f9-9ece-c0bdef6c5fa8 req-277886cd-8e22-415a-b4bc-f50ed5b20e06 service nova] Creating event network-vif-unplugged:ae02a5e9-ae0b-4ea7-969c-233ed61c10d5 for instance 63c85e05-dcac-4e07-a91c-468d6ec28921 on hv-cinder-85103 Jul 26 15:03:01.716558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-2aa7314c-7631-47f9-9ece-c0bdef6c5fa8 req-277886cd-8e22-415a-b4bc-f50ed5b20e06 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038926 Jul 26 15:03:01.717153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 458/896] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:01.871658 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:01.874489 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:01.881806 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.882265 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.883189 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:01.883661 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:01.953864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:01.961478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-129e85f4-86f4-4b55-a16d-0b9e8bec2f31 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.093936 Jul 26 15:03:01.962055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 439/897] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:01 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:02.147224 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:02.148202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:02.154499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.154951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.155759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.156202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.294475 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:02.302979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:02.304549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:02.305770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-23a8fb0c-91f7-41cc-9ad4-ed61f9c77ae1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.163338 Jul 26 15:03:02.312514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 459/898] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:02 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:02.721990 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:02.722523 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:02.728617 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.729067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.729938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.730376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.888910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:02.897981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4d0069ea-c72a-42ac-89fe-c9f04c74cdc1 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.179551 Jul 26 15:03:02.898630 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 440/899] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:02 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:02.985628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:02.986493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:02.993749 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.994324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:02.995193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:02.995765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.139810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:03.139810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-09c43a96-4168-4955-aa5c-ca2bf4c29a11 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.100263 Jul 26 15:03:03.139810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 460/900] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:02 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:03.329507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:03.330148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:03.337011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.337473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.338268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.338785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.482601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:03.498571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:03.500427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:03.501840 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2d2d0043-3938-4a2c-a2eb-77221d149636 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.176318 Jul 26 15:03:03.516404 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 441/901] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:03 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:03.920618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:03.921439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:03.929244 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.929716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:03.930555 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:03.931046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.073458 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:04.082841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cebee8ac-6c82-43bc-b9dd-215f20c5ee02 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.166288 Jul 26 15:03:04.084377 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 461/902] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:03 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:04.161431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:04.162305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:04.170874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.171570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.173170 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.173610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.241104 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:04.248899 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4dfd4d8a-ac79-4cc7-95e4-295da100eaf9 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.092355 Jul 26 15:03:04.253291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 442/903] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:04 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:04.527007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:04.527637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:04.533782 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.534235 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.535011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:04.535478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:04.677975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:04.687194 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:04.688920 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:04.690117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1964ae5e-8655-4774-a59a-9b9a6022fec9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.167367 Jul 26 15:03:04.691053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 462/904] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:04 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:05.109039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:05.109761 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:05.116000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.116540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.117380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.117890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.270238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.270803 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:05.271218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:05.273682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:05.278164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2e845ec3-ce35-4530-a4a9-013d1cd45873 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.172982 Jul 26 15:03:05.278508 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.278738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 443/905] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:05 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:05.278970 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.279926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.280372 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.353479 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.361061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d724b275-a94d-4271-8d05-5ad6c6f2a4c6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.094784 Jul 26 15:03:05.364812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 463/906] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:05 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:05.709958 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:05.714550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:05.715438 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:05.722629 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.723091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.726424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:05.726424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:05.868305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.877015 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.878564 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:05.879763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-72b6473f-e767-4d8b-af7d-a2ed7fe6bf1a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.170609 Jul 26 15:03:05.880324 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 444/907] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:05 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:06.300939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:06.301549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:06.308446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.308852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.309619 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.310059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.382809 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:06.383571 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:06.391838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.391838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.398267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=8 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:06.400506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.401005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.461708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:06.469730 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-18a20351-d367-4d36-a706-a3ad2680965a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.173401 Jul 26 15:03:06.470610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 464/908] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:06 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:06.487516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:06.495099 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-988aab80-660b-4cec-b47b-bfc3677d2fd3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.116804 Jul 26 15:03:06.495694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 445/909] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:06 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:06.902573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:06.903183 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:06.909733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.910140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:06.910909 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:06.911349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.053468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.062650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.064493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.065823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3d9856e9-0880-4912-98bb-9b82c5cc7fe0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.167139 Jul 26 15:03:07.066557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 465/910] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:06 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:07.491555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:07.492148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:07.498839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.499322 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.500113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.500560 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.518163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:07.518779 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:07.526129 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.526583 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.527357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:07.527827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:07.607123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.615890 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dc46762b-fe66-4b03-b89f-2131b43a25bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.101390 Jul 26 15:03:07.616484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 466/911] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:07 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:07.666619 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:07.674758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-52065261-abde-4b8a-bf9e-8a88baafd738 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.187189 Jul 26 15:03:07.675422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 446/912] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:07 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:08.090819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:08.091465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:08.097494 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.097949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.098766 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.099217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.238028 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.244557 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.246071 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.247243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6e8e3301-6081-4bd8-b8a4-7b6ae785fb7d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.160440 Jul 26 15:03:08.247858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 467/913] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:08 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:08.636138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:08.636775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:08.643546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.644029 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.644805 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.645240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.696099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:08.696656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:08.698931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:08.704090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.704549 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.705342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:08.706008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:08.708126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.715798 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b7b9686b-cf22-4421-8d55-4a1df9b8fa07 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.083518 Jul 26 15:03:08.716353 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 447/914] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:08 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:08.837285 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:08.844750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e9833b61-522a-463f-8cef-a839711d5a70 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.152624 Jul 26 15:03:08.845314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 468/915] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:08 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:09.271138 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:09.271751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:09.278038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.278490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.279260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.279730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.408771 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:09.417888 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:09.419510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:09.420669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-78a6edf7-3cbd-4f9d-accf-26fffcaf1502 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.153619 Jul 26 15:03:09.421235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 448/916] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:09 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:09.736460 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:09.747383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:09.747383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.747383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.747383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.747832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.811159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:09.818772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a6f7e251-1d28-4e02-8cf8-6d48fd91176e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.086278 Jul 26 15:03:09.820256 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 469/917] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:09 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:09.866707 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:09.867319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:09.873816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.874269 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:09.875043 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:09.875543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.009106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.017494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-daa05a25-63e7-4f72-b65f-edb012129f57 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.155100 Jul 26 15:03:10.018231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 449/918] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:09 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:10.444661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:10.445266 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:10.451256 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.451734 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.452500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.453030 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.586645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.595099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.596695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.597842 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-36a7a16a-b050-4b7e-9f73-d12235977656 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.157656 Jul 26 15:03:10.598398 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 470/919] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:10 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:10.840480 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:10.841144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:10.847620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.853936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.853936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:10.853936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:10.853936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:10.914254 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:10.922701 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-12cd9991-a292-4f5c-a116-584e175b5c80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.087038 Jul 26 15:03:10.924551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 450/920] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:10 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:11.042046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:11.043004 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:11.052206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.054402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.054402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.054963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.188963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:11.196714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-699d5836-4bfd-4265-b062-3375a6adb94c tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.161225 Jul 26 15:03:11.197272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 471/921] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:11 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:11.621621 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:11.622297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:11.628785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.629233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.630008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.630478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.761358 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:11.769721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:11.771208 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:11.772390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-077d689d-faf6-4b1a-94c0-92baf870cffd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.155029 Jul 26 15:03:11.773209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 451/922] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:11 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:11.945176 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:11.945698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:11.952003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.956470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.956470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:11.956470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:11.969173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:12.017617 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.025246 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fe9f805e-50d0-4896-b97f-471902037ea1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1266 microversion: 2.1 time: 0.084789 Jul 26 15:03:12.025804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 472/923] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:11 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:12.218270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:12.218826 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:12.225431 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.225874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.226851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.227288 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.450058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.461253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2552c126-0534-4b06-8489-3d33f8644fb7 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1681 microversion: 2.1 time: 0.246796 Jul 26 15:03:12.462047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 452/924] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:12 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:12.798885 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:12.799753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:12.811881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.812497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.813515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:12.814930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:12.965031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.973646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.975231 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:12.976467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5151c9d5-e355-4dee-856a-7effc65d3996 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.184239 Jul 26 15:03:12.977029 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 473/925] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:12 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:13.050709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:13.052058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:13.061422 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.062048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.063058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.063688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.167750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:13.180812 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c8d5daeb-e37f-4ce9-a9d7-66b0ed15dfc2 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1272 microversion: 2.1 time: 0.137419 Jul 26 15:03:13.195430 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 453/926] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:13 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:13.493416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:13.494154 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:13.502200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.502663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.504399 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.504881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.581010 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:13.589729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ea32d9a6-ad6d-46a3-a97c-da9e2440fc07 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1613 microversion: 2.1 time: 0.101016 Jul 26 15:03:13.590942 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 474/927] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:13 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:13.685140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-aacf86f1-c5c1-485e-b9f3-6ebc6b6fc29e req-2fbf38fd-682a-4dc8-a2c9-f6da177f3501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c85e05-dcac-4e07-a91c-468d6ec28921", "name": "network-vif-deleted", "tag": "ae02a5e9-ae0b-4ea7-969c-233ed61c10d5"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:13.696618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-aacf86f1-c5c1-485e-b9f3-6ebc6b6fc29e req-2fbf38fd-682a-4dc8-a2c9-f6da177f3501 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:13.697349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-aacf86f1-c5c1-485e-b9f3-6ebc6b6fc29e req-2fbf38fd-682a-4dc8-a2c9-f6da177f3501 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:13.711149 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-aacf86f1-c5c1-485e-b9f3-6ebc6b6fc29e req-2fbf38fd-682a-4dc8-a2c9-f6da177f3501 service nova] Creating event network-vif-deleted:ae02a5e9-ae0b-4ea7-969c-233ed61c10d5 for instance 63c85e05-dcac-4e07-a91c-468d6ec28921 on hv-cinder-85103 Jul 26 15:03:13.716544 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-aacf86f1-c5c1-485e-b9f3-6ebc6b6fc29e req-2fbf38fd-682a-4dc8-a2c9-f6da177f3501 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036039 Jul 26 15:03:13.721348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 454/928] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:14.000143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:14.000681 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:14.006922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.007378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.008186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.008622 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.148112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.158253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.162217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.162217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f22ceaf6-f51c-4280-9fe4-1f50257f292a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.164782 Jul 26 15:03:14.162566 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 475/929] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:13 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:14.206274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:14.207196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:14.214945 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.215590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.216633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.217134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.637009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:14.637009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:14.643522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.644559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.645976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.647686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.700891 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:14.701350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:14.701813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lazy-loading 'fault' on Instance uuid 63c85e05-dcac-4e07-a91c-468d6ec28921 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:03:14.706284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.727427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4ececaf5-1e96-40ea-95db-664276a77064 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.524625 Jul 26 15:03:14.740498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 455/930] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:14 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:14.757437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de3b593763e44e28be0f51187defa75d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace4455a9e1b44e5bf7b04fd4abf81d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:14.767000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-83c4d1c4-651e-461f-ba10-603002fcc04a tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 200 len: 1330 microversion: 2.1 time: 0.150568 Jul 26 15:03:14.767603 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 476/931] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:14 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 1330 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:15.184516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:15.185119 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:15.191369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.191860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.192655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.193094 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.373055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:15.382305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:15.383872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:15.385201 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bb37fd45-b415-41e0-8680-04e3c372ffce tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.204511 Jul 26 15:03:15.385730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 456/932] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:15 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:15.731223 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-74e0d4c7-dd3b-4746-8bf9-9cfeaa72cb12 req-32459ce5-7388-4dd0-b20e-bb74ed9fb7dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866736c8-98b7-441f-b37d-0c73e6a5e08b", "tag": "b5a1e8ca-f78d-4360-9bdf-c7858abfda14"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:15.741819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-74e0d4c7-dd3b-4746-8bf9-9cfeaa72cb12 req-32459ce5-7388-4dd0-b20e-bb74ed9fb7dd service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.742269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-74e0d4c7-dd3b-4746-8bf9-9cfeaa72cb12 req-32459ce5-7388-4dd0-b20e-bb74ed9fb7dd service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.755971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:15.755971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:15.756536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-74e0d4c7-dd3b-4746-8bf9-9cfeaa72cb12 req-32459ce5-7388-4dd0-b20e-bb74ed9fb7dd service nova] Creating event network-changed:b5a1e8ca-f78d-4360-9bdf-c7858abfda14 for instance 866736c8-98b7-441f-b37d-0c73e6a5e08b on hv-cinder-85103 Jul 26 15:03:15.759560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-74e0d4c7-dd3b-4746-8bf9-9cfeaa72cb12 req-32459ce5-7388-4dd0-b20e-bb74ed9fb7dd service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Jul 26 15:03:15.759900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.760158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 477/933] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:03:15.760365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.761150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.761592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.789449 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:15.790628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:15.799167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.799795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.800573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:15.801036 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:15.816432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 HTTP/1.1 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:03:15.818881 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:15.820552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '63c85e05-dcac-4e07-a91c-468d6ec28921'} Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:15.825169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:15.826716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:15.828234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:15.828234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-64540285-a12d-44fc-9ce6-d871dd78caf9 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 404 len: 111 microversion: 2.1 time: 0.035960 Jul 26 15:03:15.828234 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 478/934] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:15 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:03:15.829423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-650d2491-b714-4b36-ba74-a0b474030313 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '.version_select at 0x7f97e63454c0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:15.898800 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:15.901838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a07a2b4b-af67-49c9-98b2-db994663b87e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.153990 Jul 26 15:03:15.902408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 457/935] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:15 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:15.982161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-650d2491-b714-4b36-ba74-a0b474030313 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311037413" status: 202 len: 0 microversion: 2.1 time: 0.156321 Jul 26 15:03:15.982668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 479/936] 10.222.0.97 () {58 vars in 1218 bytes} [Tue Jul 26 15:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311037413 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 15:03:16.409136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:16.409750 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:16.416137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.416579 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:16.417396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.417821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:16.626278 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:16.636553 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:16.638240 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:16.639443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-bf42eabc-731a-48ef-8b55-892e4118924f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.234338 Jul 26 15:03:16.640012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 458/937] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:16 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:16.922292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:16.923016 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:16.934727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.935183 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:16.935994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:16.936481 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:17.084580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:17.092325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-550cff9a-0569-4bf8-92aa-73ed17510638 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.173922 Jul 26 15:03:17.092927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 480/938] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:16 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:17.664319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:17.664935 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:17.671442 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:17.671901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:17.672673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:17.673113 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:17.801053 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:17.809784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:17.820662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:17.820662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d8f97e52-3fa2-453a-8540-4f69fccc6bd6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.152785 Jul 26 15:03:17.820662 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 459/939] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:17 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:18.113765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:18.114353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:18.120976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.121423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.122184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.122618 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.251074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:18.251600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:18.253069 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:18.257758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.258212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.258993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.259454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.260655 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-72c355a1-63e3-4c1c-905f-b5d4528a8d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.150831 Jul 26 15:03:18.261400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 481/940] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:18 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:18.275584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 HTTP/1.1 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:18.277237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.278763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '63c85e05-dcac-4e07-a91c-468d6ec28921'} Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:18.279656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.280864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.282185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:18.282185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f2a563c7-3a26-41c4-a998-7a3c4764f171 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 404 len: 111 microversion: 2.1 time: 0.031740 Jul 26 15:03:18.282185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 460/941] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:18 2022] DELETE /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:03:18.288078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:18.288697 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 63c85e05-dcac-4e07-a91c-468d6ec28921] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:18.294752 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.295208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.296008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.296450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.309822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 HTTP/1.1 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:03:18.311352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.313208 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '63c85e05-dcac-4e07-a91c-468d6ec28921'} Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:18.314204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. Jul 26 15:03:18.315669 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:18.317108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 63c85e05-dcac-4e07-a91c-468d6ec28921 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:18.317108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1e1a27df-4eea-4034-bb47-4eeb0f725010 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921" status: 404 len: 111 microversion: 2.1 time: 0.029655 Jul 26 15:03:18.317108 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 482/942] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:18 2022] GET /compute/v2.1/servers/63c85e05-dcac-4e07-a91c-468d6ec28921 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:03:18.836396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:18.837045 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:18.843690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.844137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:18.844937 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:18.845372 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.131376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:19.140828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:19.142522 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:19.143721 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4df9853e-fbf7-4026-aa9d-d1277e17f53a tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.311723 Jul 26 15:03:19.144279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 461/943] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:18 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:19.282487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.283116 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.289948 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.290405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.291186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.291671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.426670 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:19.435140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e52dbbb9-b4da-4992-9564-ca8cdf86316d tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.156760 Jul 26 15:03:19.435758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 483/944] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:19 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:19.610478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.610985 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.618070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.618516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.619515 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.619952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.634276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 HTTP/1.1 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:19.635874 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.637473 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '1b3ca784-f197-4dfa-8592-742a8cb0b832'} Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:19.638462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.639992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.647224 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:19.648693 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-004d3342-f387-4e21-9403-9999cf09f5ce tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 404 len: 111 microversion: 2.1 time: 0.042044 Jul 26 15:03:19.649256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 462/945] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:19 2022] DELETE /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:19.657191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.657809 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 1b3ca784-f197-4dfa-8592-742a8cb0b832] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.663921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.664376 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 HTTP/1.1 Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:03:19.682857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.683906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '1b3ca784-f197-4dfa-8592-742a8cb0b832'} Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.684972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.686861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 1b3ca784-f197-4dfa-8592-742a8cb0b832 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0be26227-cba0-4790-a107-81196945483f tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832" status: 404 len: 111 microversion: 2.1 time: 0.029408 Jul 26 15:03:19.688165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 484/946] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:19 2022] GET /compute/v2.1/servers/1b3ca784-f197-4dfa-8592-742a8cb0b832 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:19.692280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.692844 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.698864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.699386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.700295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.700807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.715031 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 HTTP/1.1 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:19.717331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.718962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '5646d5b5-6207-4584-bf5b-be1d1c6904c5'} Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:19.724435 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.725659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.727030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:19.727030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-689e59be-f864-4b42-b2de-d025f30e05fe tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 404 len: 111 microversion: 2.1 time: 0.031197 Jul 26 15:03:19.727030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 463/947] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:19 2022] DELETE /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:19.732466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:19.733169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 5646d5b5-6207-4584-bf5b-be1d1c6904c5] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:19.740232 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.740693 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.741483 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:19.741909 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:19.756708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 HTTP/1.1 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:03:19.758252 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.759838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '5646d5b5-6207-4584-bf5b-be1d1c6904c5'} Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:19.763980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. Jul 26 15:03:19.765378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:19.766713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 5646d5b5-6207-4584-bf5b-be1d1c6904c5 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:19.766713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6d3a97fb-8624-4a87-898c-c2bcfcc1f922 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5" status: 404 len: 111 microversion: 2.1 time: 0.031196 Jul 26 15:03:19.766713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 485/948] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:19 2022] GET /compute/v2.1/servers/5646d5b5-6207-4584-bf5b-be1d1c6904c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:20.171049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:20.171765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:20.178613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.179076 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.179942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.180378 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.315102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:20.323933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:20.325452 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:20.326616 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-59646f59-70b6-40d0-87b6-f36cdfd9c5d8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.162041 Jul 26 15:03:20.327216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 464/949] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:20 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:20.457067 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:20.457773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:20.464739 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.465187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.466024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:20.466480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:20.605741 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:20.613438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-38127c52-6c23-4667-89d2-a97278a04504 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.160311 Jul 26 15:03:20.614006 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 486/950] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:20 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:21.253041 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:21.253551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:21.256114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:21.260825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.261406 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.262205 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.262639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.278087 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 HTTP/1.1 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:21.280004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.281574 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '7c808f60-6b5e-4ad9-8463-47c749c4ad58'} Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:21.282421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.283669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.284951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:21.284951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9e732377-bcee-45ca-a8be-dbc8107c5494 tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 404 len: 111 microversion: 2.1 time: 0.032583 Jul 26 15:03:21.284951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 465/951] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:21 2022] DELETE /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:21.290205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:21.290816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] [instance: 7c808f60-6b5e-4ad9-8463-47c749c4ad58] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:21.296832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.297280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.298046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.298539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.312402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] HTTP exception thrown: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Request method failure captured: Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 HTTP/1.1 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi3_-I2_DW7xMYhXjanMnk7wEOiPJcyiCGlfzjCHvSWz_biKAiotrAoSuTt_dHFNInlv0miw-NR8ZV_GETwY8wW8GsQBl8FV_C8Ou9K7JiE-IpuGrqS5KA_R45FOOG-5zpz5KzfqOBRdmpTIMxYu2MpSQIQcf-v5U2vjgOU_Hz7GPRdgs Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:03:21.313865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ace4455a9e1b44e5bf7b04fd4abf81d7"}]}] Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: ace4455a9e1b44e5bf7b04fd4abf81d7 Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-644049804 Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: de3b593763e44e28be0f51187defa75d Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeNegativeTest-644049804-project Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.315426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '7c808f60-6b5e-4ad9-8463-47c749c4ad58'} Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:21.316268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. Jul 26 15:03:21.318347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:03:21.319699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] Returning 404 to user: Instance 7c808f60-6b5e-4ad9-8463-47c749c4ad58 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:21.319699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f1267fdd-f9b9-4bf8-9f2c-2fcb1970f55e tempest-AttachVolumeNegativeTest-644049804 tempest-AttachVolumeNegativeTest-644049804-project] 10.222.0.97 "GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58" status: 404 len: 111 microversion: 2.1 time: 0.029024 Jul 26 15:03:21.319699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 487/952] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:21 2022] GET /compute/v2.1/servers/7c808f60-6b5e-4ad9-8463-47c749c4ad58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:21.350684 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:21.351297 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:21.357872 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.358328 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.359106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.359579 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.592833 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:21.602082 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:21.603635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:21.604830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-50fe2eb4-a15a-4f4f-81f8-999c516bab91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.258739 Jul 26 15:03:21.605373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 466/953] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:21 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:21.634768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:21.635381 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:21.642293 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.642748 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.643559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.643999 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.786509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:21.794758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7937f2c7-9c0b-4495-a327-2499e20aaced tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.163741 Jul 26 15:03:21.805660 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 488/954] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:21 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:21.961237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-12e0c0f6-000d-47ef-a626-9bf3161704b9 req-8378862d-2d3d-44c6-b2e4-e236f9f8348e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866736c8-98b7-441f-b37d-0c73e6a5e08b", "name": "network-vif-plugged", "status": "completed", "tag": "b5a1e8ca-f78d-4360-9bdf-c7858abfda14"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:21.971466 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-12e0c0f6-000d-47ef-a626-9bf3161704b9 req-8378862d-2d3d-44c6-b2e4-e236f9f8348e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:21.973013 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-12e0c0f6-000d-47ef-a626-9bf3161704b9 req-8378862d-2d3d-44c6-b2e4-e236f9f8348e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:21.985291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-12e0c0f6-000d-47ef-a626-9bf3161704b9 req-8378862d-2d3d-44c6-b2e4-e236f9f8348e service nova] Creating event network-vif-plugged:b5a1e8ca-f78d-4360-9bdf-c7858abfda14 for instance 866736c8-98b7-441f-b37d-0c73e6a5e08b on hv-cinder-85103 Jul 26 15:03:21.991065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-12e0c0f6-000d-47ef-a626-9bf3161704b9 req-8378862d-2d3d-44c6-b2e4-e236f9f8348e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034971 Jul 26 15:03:21.993682 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 467/955] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:22.627937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:22.628788 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:22.636060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.636716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:22.637295 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.637736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:22.775372 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:22.784083 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:22.785592 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:22.786865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-13e82a5e-7772-4cd4-a581-767a2ddd5b3e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.162904 Jul 26 15:03:22.787436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 489/956] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:22 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:03:22.818464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:22.819271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:22.826040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.826493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:22.827279 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:22.827737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:23.054291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:23.063034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0fee3d09-a55a-4ad7-91a8-43a7c5f7fb1c tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.248924 Jul 26 15:03:23.063992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 468/957] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:22 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:23.811197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:23.811913 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:23.821055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:23.821668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:23.822506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:23.822994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:23.974816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:23.981423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:23.983011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:23.984493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-49279e37-e1a4-434c-85b5-33f1f4cda613 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.178101 Jul 26 15:03:23.985059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 490/958] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:23 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:03:24.006965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-497b1897-3134-405f-aa10-0faed9ce6921 req-28d72900-f225-4f47-ac24-dfaf048a1c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "name": "network-vif-plugged", "status": "completed", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:24.018154 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-497b1897-3134-405f-aa10-0faed9ce6921 req-28d72900-f225-4f47-ac24-dfaf048a1c9b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:24.018653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-497b1897-3134-405f-aa10-0faed9ce6921 req-28d72900-f225-4f47-ac24-dfaf048a1c9b service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:24.038493 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-497b1897-3134-405f-aa10-0faed9ce6921 req-28d72900-f225-4f47-ac24-dfaf048a1c9b service nova] Creating event network-vif-plugged:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:03:24.045981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-497b1897-3134-405f-aa10-0faed9ce6921 req-28d72900-f225-4f47-ac24-dfaf048a1c9b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041497 Jul 26 15:03:24.046176 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 469/959] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:24.087846 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:24.088450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:24.094649 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:24.095096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:24.095896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:24.096333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:24.238096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:24.246303 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5a70e313-01f3-4ff1-b387-bb7007f0231b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1314 microversion: 2.1 time: 0.162312 Jul 26 15:03:24.246924 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 491/960] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:24 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:25.009660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:25.010479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:25.017380 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.018191 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.019057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.019975 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.241132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:25.250654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:25.252349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:25.253510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-99363df9-031f-4fcb-9bfd-54223fe46ccf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.249297 Jul 26 15:03:25.254063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 470/961] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:25 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:03:25.267647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:25.268280 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:25.275942 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.276409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.277254 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:25.277721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:25.437973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:25.448320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ff103446-5977-4e7e-b49b-3548e79dd067 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1497 microversion: 2.1 time: 0.184563 Jul 26 15:03:25.449088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 492/962] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:25 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:26.280927 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:26.281510 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:26.288915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.298379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.298379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.298379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.305332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:26.421613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:26.430103 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:26.431695 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:26.432850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5d595ff7-ad63-452a-a452-c7d601a40b98 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.156056 Jul 26 15:03:26.433581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 471/963] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:26 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:26.607364 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:26.608512 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:26.615320 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.615914 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.616642 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:26.617130 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:26.644009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:03:26.647921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:27.106259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-396d920a-c335-4d77-9bfa-09468e763dd1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "DELETE /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 204 len: 0 microversion: 2.1 time: 0.502601 Jul 26 15:03:27.106849 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 493/964] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:26 2022] DELETE /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:03:27.122836 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:27.123490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:27.129788 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.130242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.131016 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.131481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.265520 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:27.273979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f4fa6541-5dfc-4568-ae99-f4afbeb3f7a7 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1503 microversion: 2.1 time: 0.155100 Jul 26 15:03:27.274539 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 472/965] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:27 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:27.456694 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:27.457395 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:27.464206 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.464663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.465437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:27.465878 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:27.614438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:27.624175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:27.627586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:27.627586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f8b72425-c9d2-4e33-9dca-eb19e2747258 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.174572 Jul 26 15:03:27.627586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 494/966] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:27 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:28.295878 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:28.297695 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:28.303193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:28.303700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:28.304486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:28.304932 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:28.436546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:28.444404 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-255f1f22-01b5-483d-a6b1-8b6f051fa9c5 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1503 microversion: 2.1 time: 0.152446 Jul 26 15:03:28.444960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 473/967] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:28 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:28.650983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:28.651641 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:28.658472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:28.658941 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:28.665781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:28.665781 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:28.793728 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:28.802740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:28.804388 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:28.805685 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bcdad881-8629-4ca8-bf6f-c1b410bcc005 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1807 microversion: 2.20 time: 0.158735 Jul 26 15:03:28.822212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 495/968] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:28 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:03:29.466256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:29.467187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:29.475343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.475819 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.476601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.477039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.626961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:29.635809 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ad79bcec-1265-456e-beb8-abd1b10de334 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1503 microversion: 2.1 time: 0.173559 Jul 26 15:03:29.636381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 474/969] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:29 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:29.836948 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:29.836948 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:29.842601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.843058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.843863 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.844306 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.870487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-80aa8fab-02d0-48b7-8af5-249f0b6e672f req-9183f57c-3b67-4ce8-b939-167f063f66fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866736c8-98b7-441f-b37d-0c73e6a5e08b", "name": "network-vif-deleted", "tag": "b5a1e8ca-f78d-4360-9bdf-c7858abfda14"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:29.880647 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-80aa8fab-02d0-48b7-8af5-249f0b6e672f req-9183f57c-3b67-4ce8-b939-167f063f66fa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:29.881090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-80aa8fab-02d0-48b7-8af5-249f0b6e672f req-9183f57c-3b67-4ce8-b939-167f063f66fa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:29.892369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-80aa8fab-02d0-48b7-8af5-249f0b6e672f req-9183f57c-3b67-4ce8-b939-167f063f66fa service nova] Creating event network-vif-deleted:b5a1e8ca-f78d-4360-9bdf-c7858abfda14 for instance 866736c8-98b7-441f-b37d-0c73e6a5e08b on hv-cinder-85103 Jul 26 15:03:29.907465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-80aa8fab-02d0-48b7-8af5-249f0b6e672f req-9183f57c-3b67-4ce8-b939-167f063f66fa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164355 Jul 26 15:03:29.908533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 496/970] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:29.994715 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.005827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.008312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.010223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b3cc7b5a-3a5b-4a60-8364-20faf048a995 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1794 microversion: 2.20 time: 0.178573 Jul 26 15:03:30.010783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 475/971] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:03:29 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:03:30.657800 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:30.658436 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:30.665471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.665928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.666727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.667179 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.700913 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:30.701432 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:30.701893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lazy-loading 'fault' on Instance uuid 866736c8-98b7-441f-b37d-0c73e6a5e08b {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:03:30.747639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:30.756236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bd6d8689-88f8-419a-bdaf-c76212f25d41 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 200 len: 1304 microversion: 2.1 time: 0.102701 Jul 26 15:03:30.757002 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 497/972] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:30 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:31.777669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:31.778424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 866736c8-98b7-441f-b37d-0c73e6a5e08b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:31.784933 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:31.785384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:31.786156 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:31.786597 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:31.800164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] HTTP exception thrown: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Request method failure captured: Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b HTTP/1.1 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AIbRhuWs5CTEjdz8D8RzlogmmzdLKwvxKW_nrW0gVBUIansRIbxQAyVxyrMUOQ9Do6CMjnzi-j5K_7NiZkMuJKffmV11coBdAlDSRQ59B3NQRbXV0ksbYA8QguMotCCMrQ56bV4oeYFtm1aUCOdalthdkhi4Oqjn4wzrnDR244Y9UY Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ba1773de981b41bd829bc90d92f2f649 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:31.802316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ba1773de981b41bd829bc90d92f2f649"}]}] Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ba1773de981b41bd829bc90d92f2f649 Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesActionsTest-1109963550-project Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 39d959e5dbd346708e87b496d344af28 Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesActionsTest-1109963550-project Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. Jul 26 15:03:31.803962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '866736c8-98b7-441f-b37d-0c73e6a5e08b'} Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:31.804815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. Jul 26 15:03:31.806001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:31.807117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Returning 404 to user: Instance 866736c8-98b7-441f-b37d-0c73e6a5e08b could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:31.807117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c76a5fd7-0601-4c97-9df4-36d63c6898a6 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b" status: 404 len: 111 microversion: 2.1 time: 0.029955 Jul 26 15:03:31.807117 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 476/973] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:31 2022] GET /compute/v2.1/servers/866736c8-98b7-441f-b37d-0c73e6a5e08b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:03:31.915700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1596092064", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "networks": [{"uuid": "b73b63f9-386d-4870-ba80-b40f9d9a2c7e"}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:31.975126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] validate_networks() for [('b73b63f9-386d-4870-ba80-b40f9d9a2c7e', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:03:32.571049 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:03:32.571513 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:03:32.571987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:03:32.572577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:03:32.572994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:03:32.584212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:32.586048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:32.586048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:32.586299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:32.605525 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Getting quotas for project ba1773de981b41bd829bc90d92f2f649. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:03:32.609613 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Getting quotas for user 39d959e5dbd346708e87b496d344af28 and project ba1773de981b41bd829bc90d92f2f649. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:03:32.620952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:03:32.623229 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:03:32.838586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c1fa587d-2158-4c53-8ead-19b0a36f83b4 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927401 Jul 26 15:03:32.839614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 498/974] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:03:32.854770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-84571431-d216-4437-9f9d-c605e4a187d3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:32.871623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-84571431-d216-4437-9f9d-c605e4a187d3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:32.929648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-84571431-d216-4437-9f9d-c605e4a187d3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:32.936595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-84571431-d216-4437-9f9d-c605e4a187d3 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1214 microversion: 2.1 time: 0.089914 Jul 26 15:03:32.937163 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 477/975] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:32 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:33.957823 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:33.958452 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:33.964643 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.965092 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:33.965859 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:33.966361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:34.032701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:34.041726 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f1c3a7f0-0411-4473-ab76-c652ba712c7b tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1218 microversion: 2.1 time: 0.088258 Jul 26 15:03:34.042519 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 499/976] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:33 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:35.065408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:35.065949 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:35.073371 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:35.073835 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:35.074580 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:35.075017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:35.139921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:35.142868 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a6d32411-2071-4d7b-b551-f3235e074001 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1210 microversion: 2.1 time: 0.081469 Jul 26 15:03:35.143434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 478/977] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:35 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:36.164567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:36.165350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:36.172313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:36.173172 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:36.173935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:36.174380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:36.237763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:36.245684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-70dd51c6-1854-4880-b26e-b0ad54f318bd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1274 microversion: 2.1 time: 0.085949 Jul 26 15:03:36.246253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 500/978] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:36 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:37.266291 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:37.266928 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:37.274525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:37.274997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:37.275791 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:37.276238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:37.433575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:37.441519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4ecc3b74-dfe6-4c5b-a1e5-7d8387cb4d12 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.179213 Jul 26 15:03:37.442097 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 479/979] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:37 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:37.937877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-340923fa-33c0-4549-acd8-99e5f63235ca req-2dff4472-c1c1-4c55-bbc7-ecfcbb7a678a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3404fb91-0bb9-48ca-a96e-72a486feb249", "tag": "525f51e1-8af4-4082-bec3-f7791d2e1165"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:37.949620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-340923fa-33c0-4549-acd8-99e5f63235ca req-2dff4472-c1c1-4c55-bbc7-ecfcbb7a678a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:37.950157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-340923fa-33c0-4549-acd8-99e5f63235ca req-2dff4472-c1c1-4c55-bbc7-ecfcbb7a678a service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:37.962993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-340923fa-33c0-4549-acd8-99e5f63235ca req-2dff4472-c1c1-4c55-bbc7-ecfcbb7a678a service nova] Creating event network-changed:525f51e1-8af4-4082-bec3-f7791d2e1165 for instance 3404fb91-0bb9-48ca-a96e-72a486feb249 on hv-cinder-85103 Jul 26 15:03:37.973921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-340923fa-33c0-4549-acd8-99e5f63235ca req-2dff4472-c1c1-4c55-bbc7-ecfcbb7a678a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035600 Jul 26 15:03:37.973921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 501/980] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:38.468340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:38.468935 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:38.476396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:38.476839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:38.477611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:38.478044 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:38.692713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:38.700830 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c9f99a49-6fd1-41cb-8d6e-f3f5ac5e5d66 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.236816 Jul 26 15:03:38.701333 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 480/981] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:38 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:39.722780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:39.724178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:39.726711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:39.731980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:39.732446 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:39.733249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:39.733689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:39.865191 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:39.872929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-92b44d04-81f0-4560-9970-f8dff01b97a1 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.154589 Jul 26 15:03:39.873600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 502/982] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:39 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:40.894708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:40.895652 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:40.902474 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:40.902926 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:40.903720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:40.904155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:41.038242 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:41.045706 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f4aec320-a09c-4cb7-b337-ad5205d335c0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.154647 Jul 26 15:03:41.046150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 481/983] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:40 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:42.066287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:42.069393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:42.074384 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:42.074979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:42.075799 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:42.076249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:42.233645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:42.241821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8b709b3e-ce1e-4e9d-85b8-5d8e1bb5fbde tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.179531 Jul 26 15:03:42.242326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 503/984] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:42 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:43.263742 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:43.264360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:43.267048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:43.273273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:43.273732 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:43.274514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:43.274951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:43.420723 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:43.429042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-24ef37f6-29d7-4153-bdb8-670d86723ad0 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.169248 Jul 26 15:03:43.429624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 482/985] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:43 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:44.449393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:44.450043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:44.451911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:44.452674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:44.458062 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:44.458559 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:44.459288 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:44.459753 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:44.614184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:44.622357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-72083968-9cdc-486e-8591-c10369176096 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.176847 Jul 26 15:03:44.627463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 504/986] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:44 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:45.645269 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:45.646027 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:45.653865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.654319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.655120 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:45.655611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:45.797512 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:45.805350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c7c25d96-867b-49bc-9f85-14480b868562 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.164184 Jul 26 15:03:45.805913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 483/987] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:45 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:46.049883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-edb24446-43d3-4644-9ad6-081774e6c65e req-d6a4fa83-da04-4692-8a77-42b7cd1748b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3404fb91-0bb9-48ca-a96e-72a486feb249", "name": "network-vif-plugged", "status": "completed", "tag": "525f51e1-8af4-4082-bec3-f7791d2e1165"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:46.064858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-edb24446-43d3-4644-9ad6-081774e6c65e req-d6a4fa83-da04-4692-8a77-42b7cd1748b5 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:46.065187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-edb24446-43d3-4644-9ad6-081774e6c65e req-d6a4fa83-da04-4692-8a77-42b7cd1748b5 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:46.077880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-edb24446-43d3-4644-9ad6-081774e6c65e req-d6a4fa83-da04-4692-8a77-42b7cd1748b5 service nova] Creating event network-vif-plugged:525f51e1-8af4-4082-bec3-f7791d2e1165 for instance 3404fb91-0bb9-48ca-a96e-72a486feb249 on hv-cinder-85103 Jul 26 15:03:46.083091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-edb24446-43d3-4644-9ad6-081774e6c65e req-d6a4fa83-da04-4692-8a77-42b7cd1748b5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 Jul 26 15:03:46.083977 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 505/988] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:46.826687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:46.827125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:46.841146 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:46.841146 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:46.841146 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:46.841146 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:46.980038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:46.987314 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9ad9b1eb-a255-460f-8692-e2ddc5b93dbd tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.165164 Jul 26 15:03:46.987906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 484/989] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:46 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:48.010429 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:48.011129 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:48.017289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:48.017963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:48.018735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:48.019173 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:48.153415 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:48.161601 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-17e7f436-d30c-44e2-98db-9da6c6a85342 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1314 microversion: 2.1 time: 0.156050 Jul 26 15:03:48.166572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 506/990] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:48 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:49.182953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:49.183614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:49.190390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:49.190852 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:49.192199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:49.192637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:49.329546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:49.338366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-67eebd2b-4cb7-4b20-b583-ceb40eca5e3e tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1497 microversion: 2.1 time: 0.159396 Jul 26 15:03:49.338939 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 485/991] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:49 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:50.463562 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:50.464086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:50.473801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.473801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:50.473801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.473801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:50.497985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:03:50.876763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d685ae4e-5343-4471-8a6c-2f1b66bdea80 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "DELETE /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 204 len: 0 microversion: 2.1 time: 0.416829 Jul 26 15:03:50.877385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 507/992] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:03:50 2022] DELETE /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:03:50.886366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:50.887040 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:50.895895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.895895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:50.895895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:50.895895 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:51.060275 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:51.068027 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4298ad7d-e374-4c72-b64a-0b37248b7073 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1503 microversion: 2.1 time: 0.185718 Jul 26 15:03:51.068590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 486/993] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:50 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:52.091248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:52.091993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:52.099810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:52.100256 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:52.101024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:52.101501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:52.269767 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:52.277610 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7bbf31d5-e313-4eab-bebf-d8dce8ed696f tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1503 microversion: 2.1 time: 0.190743 Jul 26 15:03:52.278187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 508/994] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:52 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:03:53.299681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:53.300217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:53.303075 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=46 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:53.307867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:53.308554 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:53.309238 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:53.309680 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:53.502492 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-41e4765d-1024-4e1f-966d-3ff3829285de req-b54b6ced-3f2f-4e69-a56f-cdf902540cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3404fb91-0bb9-48ca-a96e-72a486feb249", "name": "network-vif-deleted", "tag": "525f51e1-8af4-4082-bec3-f7791d2e1165"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:03:53.520688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-41e4765d-1024-4e1f-966d-3ff3829285de req-b54b6ced-3f2f-4e69-a56f-cdf902540cbb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:53.521134 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-41e4765d-1024-4e1f-966d-3ff3829285de req-b54b6ced-3f2f-4e69-a56f-cdf902540cbb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:53.532875 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:53.535113 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-41e4765d-1024-4e1f-966d-3ff3829285de req-b54b6ced-3f2f-4e69-a56f-cdf902540cbb service nova] Creating event network-vif-deleted:525f51e1-8af4-4082-bec3-f7791d2e1165 for instance 3404fb91-0bb9-48ca-a96e-72a486feb249 on hv-cinder-85103 Jul 26 15:03:53.540225 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-41e4765d-1024-4e1f-966d-3ff3829285de req-b54b6ced-3f2f-4e69-a56f-cdf902540cbb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041490 Jul 26 15:03:53.540850 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-28c0ffc9-c9bf-49d5-bad0-279a5dc4d381 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1503 microversion: 2.1 time: 0.245192 Jul 26 15:03:53.540983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 509/995] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:03:53.541455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 487/996] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:53 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:54.564693 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:54.565831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:54.572797 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:54.573369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:54.574409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:54.574953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:54.579145 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:03:54.621930 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:54.622568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:54.623174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lazy-loading 'fault' on Instance uuid 3404fb91-0bb9-48ca-a96e-72a486feb249 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:03:54.677511 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d959e5dbd346708e87b496d344af28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1773de981b41bd829bc90d92f2f649', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:03:54.685623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fea5cf8e-0e9c-4c6f-a6a5-43986323f3ab tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 200 len: 1304 microversion: 2.1 time: 0.126941 Jul 26 15:03:54.691521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 510/997] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:54 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:03:55.721621 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:03:55.722287 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] [instance: 3404fb91-0bb9-48ca-a96e-72a486feb249] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:03:55.729089 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.729586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.730475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:03:55.730922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:03:55.744742 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] HTTP exception thrown: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Request method failure captured: Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 HTTP/1.1 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AIbRhuWs5CTEjdz8D8RzlogmmzdLKwvxKW_nrW0gVBUIansRIbxQAyVxyrMUOQ9Do6CMjnzi-j5K_7NiZkMuJKffmV11coBdAlDSRQ59B3NQRbXV0ksbYA8QguMotCCMrQ56bV4oeYFtm1aUCOdalthdkhi4Oqjn4wzrnDR244Y9UY Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: ba1773de981b41bd829bc90d92f2f649 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:03:55.746284 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ba1773de981b41bd829bc90d92f2f649"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ba1773de981b41bd829bc90d92f2f649"}]}] Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: ba1773de981b41bd829bc90d92f2f649 Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesActionsTest-1109963550 Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesActionsTest-1109963550-project Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 39d959e5dbd346708e87b496d344af28 Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesActionsTest-1109963550-project Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. Jul 26 15:03:55.748912 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '3404fb91-0bb9-48ca-a96e-72a486feb249'} Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:03:55.750423 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. Jul 26 15:03:55.753032 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:03:55.755737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] Returning 404 to user: Instance 3404fb91-0bb9-48ca-a96e-72a486feb249 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:03:55.755737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-11ccc5f0-e54c-42c3-901e-32bec3a33649 tempest-VolumesActionsTest-1109963550 tempest-VolumesActionsTest-1109963550-project] 10.222.0.97 "GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249" status: 404 len: 111 microversion: 2.1 time: 0.030146 Jul 26 15:03:55.755737 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 488/998] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:03:55 2022] GET /compute/v2.1/servers/3404fb91-0bb9-48ca-a96e-72a486feb249 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:04:37.045675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:37.046289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:37.059025 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:37.060901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.061353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.062136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.062578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.110036 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-daffdc70-f137-4161-a09e-85b13fc28cf6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments/ec515a3e-2adf-4e46-bfaa-952a81016341" status: 200 len: 194 microversion: 2.20 time: 0.068361 Jul 26 15:04:37.110713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 511/999] 10.222.0.97 () {60 vars in 1454 bytes} [Tue Jul 26 15:04:37 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments/ec515a3e-2adf-4e46-bfaa-952a81016341 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:04:37.195088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:37.195980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:37.201188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:37.204026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=91 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:04:37.209610 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.210774 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.211890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.212477 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.320027 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lazy-loading 'services' on Instance uuid d566308c-cba6-4925-8ac6-820573486d4b {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:04:37.626280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d8e277ad-b517-4a81-a9c9-5611201a8611 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments/ec515a3e-2adf-4e46-bfaa-952a81016341" status: 202 len: 0 microversion: 2.20 time: 0.436897 Jul 26 15:04:37.626280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 489/1000] 10.222.0.97 () {60 vars in 1457 bytes} [Tue Jul 26 15:04:37 2022] DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments/ec515a3e-2adf-4e46-bfaa-952a81016341 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:04:37.634569 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:37.637223 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:37.645411 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.646146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.647202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:37.647724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:37.694357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b709365a-c175-48b4-b94a-b5e8bd58f537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064263 Jul 26 15:04:37.695561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 512/1001] 10.222.0.97 () {60 vars in 1343 bytes} [Tue Jul 26 15:04:37 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:04:38.708273 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:38.710915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:38.720373 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:38.724696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:38.724696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:38.724696 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:38.759533 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c25b961a-2911-49f3-83ae-78562d60e677 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056667 Jul 26 15:04:38.760392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 490/1002] 10.222.0.97 () {60 vars in 1343 bytes} [Tue Jul 26 15:04:38 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:04:39.773464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:39.775688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:39.783927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.784382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.785249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.785688 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.820248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-acc43153-cd11-4531-8375-bea0f2e91ffb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051167 Jul 26 15:04:39.820939 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 513/1003] 10.222.0.97 () {60 vars in 1343 bytes} [Tue Jul 26 15:04:39 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:39.895762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:39.896331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:39.904278 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.904841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.905694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:39.906229 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:39.937710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:04:40.322751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-1965d1d3-aae5-40f3-854b-51ea70a7bf82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 204 len: 0 microversion: 2.20 time: 0.431221 Jul 26 15:04:40.323772 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 491/1004] 10.222.0.97 () {60 vars in 1280 bytes} [Tue Jul 26 15:04:39 2022] DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:04:40.333762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:40.335733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:40.341686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:40.342146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:40.342963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:40.343813 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:40.490050 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:40.498906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:40.501811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:40.503187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e36e9440-2c17-4ede-9811-10dca55ff537 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.175099 Jul 26 15:04:40.504994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 514/1005] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:40 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:04:41.527802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:41.528565 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:41.538034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:41.538609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:41.541367 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:41.541367 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:41.783286 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:41.799935 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:41.801467 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:41.802778 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b04109fe-937e-4091-876c-56d68cbd09cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.279508 Jul 26 15:04:41.803347 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 492/1006] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:41 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:42.830496 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:42.831203 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:42.838663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:42.839322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:42.840146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:42.840891 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:43.042776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:43.054040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:43.059162 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:43.059875 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a9412d49-e81e-4c7b-a041-db6a17daeb0e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1722 microversion: 2.20 time: 0.234864 Jul 26 15:04:43.061718 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 515/1007] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:42 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:43.422584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-e5f73ec7-67a9-4352-8eee-a6c16ef4e91c req-9c987231-1c63-4ac8-811b-6e25c500bbe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d566308c-cba6-4925-8ac6-820573486d4b", "name": "network-vif-deleted", "tag": "8504fd36-c770-40f1-b4b9-12e64454c451"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:43.440455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e5f73ec7-67a9-4352-8eee-a6c16ef4e91c req-9c987231-1c63-4ac8-811b-6e25c500bbe6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:43.443915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e5f73ec7-67a9-4352-8eee-a6c16ef4e91c req-9c987231-1c63-4ac8-811b-6e25c500bbe6 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:43.460171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-e5f73ec7-67a9-4352-8eee-a6c16ef4e91c req-9c987231-1c63-4ac8-811b-6e25c500bbe6 service nova] Creating event network-vif-deleted:8504fd36-c770-40f1-b4b9-12e64454c451 for instance d566308c-cba6-4925-8ac6-820573486d4b on hv-cinder-85103 Jul 26 15:04:43.477401 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-e5f73ec7-67a9-4352-8eee-a6c16ef4e91c req-9c987231-1c63-4ac8-811b-6e25c500bbe6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058207 Jul 26 15:04:43.478143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 493/1008] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:44.086419 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:44.087764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:44.105169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:44.106039 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:44.107520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:44.108161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:44.190221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:44.190689 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:44.191156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lazy-loading 'fault' on Instance uuid d566308c-cba6-4925-8ac6-820573486d4b {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:04:44.277317 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:44.290959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:44.292878 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:44.294493 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d4816cc6-2b47-4c78-a553-f6dd976e964d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 200 len: 1371 microversion: 2.20 time: 0.212397 Jul 26 15:04:44.307768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 516/1009] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:44 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:45.325639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:45.326465 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:45.336694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:45.346484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:45.347611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:45.348173 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:45.367781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b HTTP/1.1 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:04:45.370038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:04:45.371993 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'd566308c-cba6-4925-8ac6-820573486d4b'} Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:04:45.372976 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:04:45.379009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:04:45.380513 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:04:45.380513 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c1fde9dc-86de-4a70-a845-a4e792290b04 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 404 len: 111 microversion: 2.20 time: 0.052737 Jul 26 15:04:45.380513 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 494/1010] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:45 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:04:45.384242 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e7b08941-d1d9-4ec3-a87e-4dc950612fd8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '.version_select at 0x7f97e63d9550>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:45.504089 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e7b08941-d1d9-4ec3-a87e-4dc950612fd8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-122912433" status: 204 len: 0 microversion: 2.20 time: 0.119933 Jul 26 15:04:45.504976 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 517/1011] 10.222.0.97 () {60 vars in 1259 bytes} [Tue Jul 26 15:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-122912433 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:04:47.062585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-37fa1e1c-0d8b-473c-b118-379c77a14309 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: .version_select at 0x7f97e60f4700>, body: {"keypair": {"name": "tempest-keypair-1406812991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPT63QMgiPbbRzJysKH/IVPPBrCiZnINu1VNtHvtI3DQYOUxFJ/WejviLerv8DsjtQo/tFOEm0POvQ0d/WANCekOBSKlbkxwhnKp1RY3Ty7mKPL216o9th/pcpO8TDklw=="}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:47.084797 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-37fa1e1c-0d8b-473c-b118-379c77a14309 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for project 7f82b8853b874e61820108bc16e8dc41. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:47.090039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-37fa1e1c-0d8b-473c-b118-379c77a14309 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for user df675a52f9b245198897842f7a6ecd13 and project 7f82b8853b874e61820108bc16e8dc41. Resources: {'key_pairs'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:47.239960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-37fa1e1c-0d8b-473c-b118-379c77a14309 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.181157 Jul 26 15:04:47.241165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 495/1012] 10.222.0.97 () {62 vars in 1200 bytes} [Tue Jul 26 15:04:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 183 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 15:04:50.381698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-491802512", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40bf059a-9593-4ce0-be05-c864bfa3c074"}], "security_groups": [{"name": "tempest-securitygroup--1919569397"}], "key_name": "tempest-keypair-1406812991", "user_data": "}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:50.556467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] validate_networks() for [('40bf059a-9593-4ce0-be05-c864bfa3c074', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:04:51.121630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:04:51.122319 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:04:51.122785 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:04:51.123203 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:04:51.123675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:04:51.134087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:51.134537 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:51.135368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:51.135838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:51.155370 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for project 7f82b8853b874e61820108bc16e8dc41. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:51.160298 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Getting quotas for user df675a52f9b245198897842f7a6ecd13 and project 7f82b8853b874e61820108bc16e8dc41. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:51.172230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:04:51.175100 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:04:51.353071 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3392e5d5-5c3d-43dd-b57f-ba6200c3a1de tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.976860 Jul 26 15:04:51.354160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 518/1013] 10.222.0.97 () {62 vars in 1188 bytes} [Tue Jul 26 15:04:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 26 15:04:51.364908 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:51.365529 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:51.447237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:51.457886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:51.459745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:51.460884 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-55a21d57-466e-4204-895d-fe0599842612 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1281 microversion: 2.20 time: 0.099946 Jul 26 15:04:51.461443 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 496/1014] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:51 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:52.488048 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:52.489331 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:52.496878 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:52.499476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:52.499476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:52.499476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:52.567112 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:52.576093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:52.577662 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:52.579686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0d5426d8-d4db-4a32-96fd-659fa02bdaf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1285 microversion: 2.20 time: 0.097095 Jul 26 15:04:52.580522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 519/1015] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:52 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:53.602026 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:53.602639 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:53.609411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:53.610540 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:53.611388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:53.611801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:53.678184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:53.686887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:53.688478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:53.690235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-19d25160-e993-400b-bd09-c60d76df976d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1277 microversion: 2.20 time: 0.091570 Jul 26 15:04:53.690796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 497/1016] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:53 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:53.991316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5fb4fc64-7031-474f-8b06-d3d14dba40a3 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'create', calling method: .version_select at 0x7f97e630d5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-180171367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/VOvDMm1lbC1q7baigwibW6xE7T4DJd/dsxFLpqJqdkY6c7Xcgt/VYUHJPNrqm/Ons/g9idznXNtpp91+QGdUvDDzx8ekTyfuo5UY/LeXVkRUXpyvVrYHluAhwBuMWzg=="}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:54.007482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-5fb4fc64-7031-474f-8b06-d3d14dba40a3 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Getting quotas for project d057f29b771a4110be66186949246663. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:54.011437 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-5fb4fc64-7031-474f-8b06-d3d14dba40a3 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Getting quotas for user 7338eed24b4a42208d4395e93d464d65 and project d057f29b771a4110be66186949246663. Resources: {'key_pairs'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:54.119996 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5fb4fc64-7031-474f-8b06-d3d14dba40a3 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.132522 Jul 26 15:04:54.120721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 520/1017] 10.222.0.97 () {60 vars in 1159 bytes} [Tue Jul 26 15:04:53 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:54.172232 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1017986902", "imageRef": "ba9439cc-0e8e-482b-8b47-e9cbf52f225d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-180171367", "networks": [{"uuid": "bf886878-6d84-4a71-af9c-be5dc52b71cd"}]}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:54.226479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] validate_networks() for [('bf886878-6d84-4a71-af9c-be5dc52b71cd', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:04:54.713351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:54.714415 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:54.727312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:54.727816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:54.728627 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:54.729070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:54.797445 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:54.806811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:54.808421 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:54.809548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c641a151-7b07-4905-aa0c-56202a3fe8cd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1341 microversion: 2.20 time: 0.101204 Jul 26 15:04:54.810153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 521/1018] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:54 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1341 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:04:54.822083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:04:54.822801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:04:54.823687 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:04:54.824551 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:04:54.825231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:04:54.835319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:54.835829 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:54.839760 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:54.840233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:54.858352 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Getting quotas for project d057f29b771a4110be66186949246663. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:04:54.863006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Getting quotas for user 7338eed24b4a42208d4395e93d464d65 and project d057f29b771a4110be66186949246663. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:04:54.875320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:04:54.877827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba9439cc-0e8e-482b-8b47-e9cbf52f225d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:04:55.066349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-267634fe-36ed-4062-85f9-b092fc21bb61 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898079 Jul 26 15:04:55.067000 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 498/1019] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:04:55.082326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-672d0a15-f134-4e9f-855d-98f50609772a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:55.082964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-672d0a15-f134-4e9f-855d-98f50609772a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:55.169209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-672d0a15-f134-4e9f-855d-98f50609772a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:55.177090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-672d0a15-f134-4e9f-855d-98f50609772a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1258 microversion: 2.1 time: 0.102780 Jul 26 15:04:55.179445 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 522/1020] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:55 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1258 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:55.834126 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:55.834930 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:55.844741 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:55.845258 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:55.846175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:55.846722 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:56.090819 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:56.099272 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:56.100845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:56.101981 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-812b2e5c-1661-46b0-a893-ede285866bc0 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.273492 Jul 26 15:04:56.102543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 499/1021] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:55 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:56.198300 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9d195f76-2b5b-4d5d-8a05-70da6a938f16 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:56.204544 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9d195f76-2b5b-4d5d-8a05-70da6a938f16 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:56.256187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d195f76-2b5b-4d5d-8a05-70da6a938f16 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:56.261841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9d195f76-2b5b-4d5d-8a05-70da6a938f16 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1258 microversion: 2.1 time: 0.067493 Jul 26 15:04:56.262407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 523/1022] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:56 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:04:56.761837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-eae78e9c-02c0-448f-9603-0f2d260dece3 req-4688aac5-c9d6-40e1-9464-8bd67e350410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:04:56.788408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-eae78e9c-02c0-448f-9603-0f2d260dece3 req-4688aac5-c9d6-40e1-9464-8bd67e350410 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:56.792768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-eae78e9c-02c0-448f-9603-0f2d260dece3 req-4688aac5-c9d6-40e1-9464-8bd67e350410 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:56.802086 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-eae78e9c-02c0-448f-9603-0f2d260dece3 req-4688aac5-c9d6-40e1-9464-8bd67e350410 service nova] Creating event network-changed:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:04:56.807611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-eae78e9c-02c0-448f-9603-0f2d260dece3 req-4688aac5-c9d6-40e1-9464-8bd67e350410 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049832 Jul 26 15:04:56.808890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 500/1023] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:04:57.125407 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:57.126337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:57.133003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:57.133631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:57.134587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:57.135194 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:57.278820 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:57.284529 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:57.285251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:57.289249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:57.290973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:57.292235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:57.292382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b28e6855-6b8a-4984-8c8a-6f7549616264 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.170833 Jul 26 15:04:57.292699 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:57.293434 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 524/1024] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:57 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:57.293577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:57.293914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:57.372650 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:57.380886 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-51649fa3-bfad-4bf7-8e6c-5e7e2b09114d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1262 microversion: 2.1 time: 0.102034 Jul 26 15:04:57.383391 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 501/1025] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:57 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1262 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:04:58.315365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:58.316055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:58.322746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:58.323199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:58.324017 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:58.324509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:58.404375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:58.404978 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:58.412386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:58.412911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:58.413757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:58.414269 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:58.469649 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:58.478620 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:58.480324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:58.481568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c464359e-5080-4c6d-a137-6244aacc45be tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.170751 Jul 26 15:04:58.482220 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 525/1026] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:58 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:04:58.486326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:58.494064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6018b414-6664-418f-ba0e-69bc2942241f tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1310 microversion: 2.1 time: 0.094485 Jul 26 15:04:58.494641 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 502/1027] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:58 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:04:59.505117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:59.505729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:59.512877 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:59.513345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:59.514136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:59.514583 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:59.516736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:04:59.517386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:04:59.524362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:59.524810 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:59.525586 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:04:59.526023 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:04:59.600090 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:59.607920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-02ef11cc-9eb0-4d81-be85-88d31e9e0cf9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1310 microversion: 2.1 time: 0.095695 Jul 26 15:04:59.608501 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 503/1028] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:04:59 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:04:59.654981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:59.663625 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:59.665166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:04:59.666288 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8e370cb8-efdf-41c6-83cb-681d9d3249fe tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.165163 Jul 26 15:04:59.666856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 526/1029] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:04:59 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:00.628618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:00.629436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:00.636174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:00.636632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:00.637427 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:00.637870 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:00.688716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:00.689374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:00.696479 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:00.699946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:00.699946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:00.699946 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:00.701718 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:00.710009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e0d90fc8-a5bc-475f-b7cc-1c1c25bbbdaa tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1318 microversion: 2.1 time: 0.085293 Jul 26 15:05:00.710514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 504/1030] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:00 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1318 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:00.840686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:00.850263 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:00.851954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:00.853099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-930bb6e8-c831-4fdb-89b3-578f4e434e88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.168435 Jul 26 15:05:00.853650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 527/1031] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:00 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:05:01.739344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:01.740178 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:01.752471 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:01.753249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:01.754091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:01.754532 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:01.875598 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:01.876852 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:01.879198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:01.884801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:01.885251 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:01.886353 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:01.886866 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:01.928569 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:01.937008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-41613831-febb-403c-8067-df3b1c64f97e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.208301 Jul 26 15:05:01.937628 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 505/1032] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:01 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:02.032417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:02.044514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:02.046076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:02.047981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bee3ee43-895b-4c06-ac68-8d68e5089736 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.175636 Jul 26 15:05:02.048674 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 528/1033] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:01 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:02.958746 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:02.959748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:02.966705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:02.967274 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:02.968246 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:02.968735 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:03.070125 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:03.071794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:03.097880 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:03.098962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:03.100127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:03.100846 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:03.114508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:03.123670 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a6ad0aa9-9a01-49ca-8bad-ee38fe742fdc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.168713 Jul 26 15:05:03.139795 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 506/1034] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:02 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:03.289466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:03.297962 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:03.299740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:03.301076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f39423ff-377e-4146-93d0-85f009af8c0b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.234892 Jul 26 15:05:03.301806 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 529/1035] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:03 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:05:04.148199 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:04.148923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:04.155951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:04.157140 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:04.158455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:04.159122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:04.310908 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:04.314619 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:04.319028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d582f394-5bf4-497d-bcb0-35cfd184e797 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.175748 Jul 26 15:05:04.319620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 507/1036] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:04 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:04.339650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:04.341014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:04.349342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:04.350085 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:04.351105 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:04.351856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:04.503808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:04.507072 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:04.515024 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:04.532900 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:04.533696 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-99d3f684-dfe1-4ab3-b0a8-64d1c7455055 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.198208 Jul 26 15:05:04.541304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 530/1037] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:04 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:05:04.724064 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-16b6228f-f9cc-4a1e-bb3f-e3928a727857 req-21fa6e2a-f7fb-4d68-bf16-cea71d01bbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "name": "network-vif-plugged", "status": "completed", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:04.736065 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-16b6228f-f9cc-4a1e-bb3f-e3928a727857 req-21fa6e2a-f7fb-4d68-bf16-cea71d01bbe9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:04.737121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-16b6228f-f9cc-4a1e-bb3f-e3928a727857 req-21fa6e2a-f7fb-4d68-bf16-cea71d01bbe9 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:04.751757 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-16b6228f-f9cc-4a1e-bb3f-e3928a727857 req-21fa6e2a-f7fb-4d68-bf16-cea71d01bbe9 service nova] Creating event network-vif-plugged:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:05:04.762390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-16b6228f-f9cc-4a1e-bb3f-e3928a727857 req-21fa6e2a-f7fb-4d68-bf16-cea71d01bbe9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176020 Jul 26 15:05:04.763268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 508/1038] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:05.342581 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:05.343204 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:05.350123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:05.350649 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:05.351494 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:05.351938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:05.501727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:05.514186 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9e8fdcc0-fae0-4b02-897a-5567570cfaf1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.175883 Jul 26 15:05:05.523237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 531/1039] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:05 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:05.561420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:05.562136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=12 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:05.567822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:05.574494 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:05.575419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:05.575966 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:05.576738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:05.577326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:05.723215 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:05.735085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:05.736706 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:05.737838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-3d178f63-1ab6-4884-9d55-b6fda42fbbbb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.177712 Jul 26 15:05:05.738570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 509/1040] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:05 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:06.537759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:06.538406 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:06.540363 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=14 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:06.545932 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:06.546382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:06.547790 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:06.548230 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:06.695686 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:06.704570 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-df8e0ea0-cde4-44b1-a5db-9cb510610f42 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.171925 Jul 26 15:05:06.710221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 532/1041] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:06 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:06.762765 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:06.763455 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:06.771713 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:06.772182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:06.772952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:06.773386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:06.920133 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:06.929002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:06.931052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:06.932331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2129bb3a-99e4-4336-a607-ba367ff5abc3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.173817 Jul 26 15:05:06.933074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 510/1042] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:06 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:07.726205 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:07.727121 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:07.735069 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:07.735545 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:07.736326 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:07.736765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:07.875202 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:07.883212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a4182653-7bbe-45d9-973b-5a1358b9d23a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.161308 Jul 26 15:05:07.883856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 533/1043] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:07 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:07.954490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:07.955142 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:07.957481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:07.962581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:07.963034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:07.963843 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:07.964271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:08.114681 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:08.123052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:08.124692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:08.125864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-585b9cce-054d-4f7e-9444-0eefca9ea256 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.175410 Jul 26 15:05:08.126601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 511/1044] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:07 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:08.905043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:08.905744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:08.912858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:08.913310 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:08.914093 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:08.914532 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:09.071926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:09.079972 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8fd09e37-562f-4fe4-945f-f7bc515f26cd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.179081 Jul 26 15:05:09.081046 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 534/1045] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:08 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:09.149070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:09.150654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:09.157864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:09.158324 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:09.159135 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:09.159591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:09.324496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:09.332714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:09.334387 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:09.335669 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4340cd34-fa80-4a5c-80e3-69eafbf6adf7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.190933 Jul 26 15:05:09.336283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 512/1046] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:09 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:10.101101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:10.101772 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:10.104121 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:10.108892 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:10.110011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:10.110790 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:10.111347 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:10.246277 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.256270 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a61acb33-2dfe-4da6-a4c7-25ecdb905fbd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.159085 Jul 26 15:05:10.261520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 535/1047] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:10 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:10.358386 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:10.358929 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:10.366137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:10.366590 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:10.367366 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:10.367849 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:10.500475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.508692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.510212 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:10.511332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a6b46ee3-d469-44aa-8cd1-615674fd1f82 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.157105 Jul 26 15:05:10.511919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 513/1048] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:10 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:11.277342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:11.278008 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:11.285031 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:11.285481 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:11.286243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:11.286675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:11.422461 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:11.430442 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-6c1464ec-edec-4925-a6bc-108ea633d6c7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.156875 Jul 26 15:05:11.431040 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 536/1049] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:11 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:11.535593 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:11.536214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:11.542784 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:11.543241 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:11.544050 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:11.544509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:11.677604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:11.685602 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:11.687722 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:11.688869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d5499ef9-e98b-4822-831e-2aba5f3bf196 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.157923 Jul 26 15:05:11.689457 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 514/1050] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:11 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:12.452673 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:12.455009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:12.460182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.460693 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.461506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.461954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.614789 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:12.622378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-328446b4-a37e-4500-8503-b9d4d44a48af tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.173852 Jul 26 15:05:12.622947 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 537/1051] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:12 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:12.779265 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:12.779962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:12.786152 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.786601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.787370 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:12.787832 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:12.960257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:12.969066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:12.970506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:12.972207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-70677f33-38dc-44d6-8e91-3b5a39dfa855 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.263639 Jul 26 15:05:12.973085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 515/1052] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:12 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:13.644351 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:13.644971 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:13.651565 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:13.652013 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:13.652769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:13.653203 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:13.786219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:13.793780 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0957d7a7-556c-446a-b671-ee84074ba940 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.154071 Jul 26 15:05:13.794352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 538/1053] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:13 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:13.995821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:13.996392 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:14.003626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.004072 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.004863 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.005296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.235555 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:14.246726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:14.248460 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:14.251618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c1e453d4-b7bb-41de-b81d-7531e44efc88 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.259662 Jul 26 15:05:14.252547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 516/1054] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:13 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:14.590690 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-57290cd8-89d1-45c9-ac27-87530ce24c4d req-bb231eb0-1475-44d9-bc91-40b140864909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:14.603533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-57290cd8-89d1-45c9-ac27-87530ce24c4d req-bb231eb0-1475-44d9-bc91-40b140864909 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.603944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-57290cd8-89d1-45c9-ac27-87530ce24c4d req-bb231eb0-1475-44d9-bc91-40b140864909 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.620348 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-57290cd8-89d1-45c9-ac27-87530ce24c4d req-bb231eb0-1475-44d9-bc91-40b140864909 service nova] Creating event network-changed:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:05:14.626297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-57290cd8-89d1-45c9-ac27-87530ce24c4d req-bb231eb0-1475-44d9-bc91-40b140864909 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039780 Jul 26 15:05:14.626917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 539/1055] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:05:14.819033 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:14.820099 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:14.830876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.831343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:14.832786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:14.833226 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.001807 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:15.006174 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-74ae400f-9171-4d60-b2e1-161cd2c1609b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.194442 Jul 26 15:05:15.006748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 517/1056] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:14 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:15.276127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:15.276827 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:15.283037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.283530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.284308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:15.284750 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:15.425906 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:15.437530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:15.437530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:15.438524 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-594394e8-8b2f-4052-9c53-4bef7d44be64 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1407 microversion: 2.20 time: 0.167476 Jul 26 15:05:15.439126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 540/1057] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:15 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:16.028285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.028910 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:16.037325 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.037964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.038866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.039475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.174191 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.181971 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-11e49bd8-d748-43ab-88da-9cc266a4b86a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.157720 Jul 26 15:05:16.182550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 518/1058] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:16.462027 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.462964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:16.472161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.472611 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.473393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.473825 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.620259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.629485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.634675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:16.634675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-31ef6a56-350d-489a-aef8-180c705dd20b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1598 microversion: 2.20 time: 0.174985 Jul 26 15:05:16.634675 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 541/1059] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1598 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:05:16.661478 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:16.661963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:16.669797 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.670244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.671271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:16.671794 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:16.796593 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-248b0266-a529-4a5f-8b70-7a483cee9459 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143111 Jul 26 15:05:16.797203 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 519/1060] 10.222.0.97 () {60 vars in 1316 bytes} [Tue Jul 26 15:05:16 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:05:17.203477 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:17.204526 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:17.210857 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.211314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.212142 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:17.212586 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:17.443253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:17.452226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a64dcc62-a923-4dd5-bff7-9b7f7a5223b2 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.252742 Jul 26 15:05:17.512990 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 542/1061] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:17 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:18.177942 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-b3594dc3-a114-410e-b0f1-58a164a1c98c req-5b232811-462c-4368-bfec-58a35a7750be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:18.193034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-b3594dc3-a114-410e-b0f1-58a164a1c98c req-5b232811-462c-4368-bfec-58a35a7750be service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.193034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-b3594dc3-a114-410e-b0f1-58a164a1c98c req-5b232811-462c-4368-bfec-58a35a7750be service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.215030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-b3594dc3-a114-410e-b0f1-58a164a1c98c req-5b232811-462c-4368-bfec-58a35a7750be service nova] Creating event network-changed:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:05:18.224344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-b3594dc3-a114-410e-b0f1-58a164a1c98c req-5b232811-462c-4368-bfec-58a35a7750be service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109333 Jul 26 15:05:18.225475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 520/1062] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:18.474189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:18.474963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:18.481850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.482315 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.483117 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:18.484097 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:18.630667 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:18.638893 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0e064918-7f47-409f-9b48-ad972b7d41ba tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.168584 Jul 26 15:05:18.639507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 543/1063] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:18 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:19.662601 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:19.663341 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:19.670166 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.670644 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.672172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:19.672611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:19.816531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:19.824300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-73e63bf9-dff8-4f79-bd2b-8abfe3bb3d0c tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.166838 Jul 26 15:05:19.824876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 521/1064] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:19 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:05:20.854164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:20.854771 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:20.861961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.862404 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.863171 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:20.863629 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:20.998546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:21.006323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7421d390-3596-4b9f-a4c0-8001fc74e173 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.156001 Jul 26 15:05:21.006901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 544/1065] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:20 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:22.028505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:22.029143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:22.035887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.036338 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.037157 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.037599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.173627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:22.186656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ea45df7e-96df-4488-88bf-0710eee9d993 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.162052 Jul 26 15:05:22.187246 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 522/1066] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:22 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:22.520096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-fc1fcd52-63a4-453e-a97f-a4b88b8fca91 req-9ef390b5-8d6f-4d94-a441-6b2114f4478e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "name": "network-vif-plugged", "status": "completed", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:22.530650 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-fc1fcd52-63a4-453e-a97f-a4b88b8fca91 req-9ef390b5-8d6f-4d94-a441-6b2114f4478e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:22.531102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-fc1fcd52-63a4-453e-a97f-a4b88b8fca91 req-9ef390b5-8d6f-4d94-a441-6b2114f4478e service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:22.544884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-fc1fcd52-63a4-453e-a97f-a4b88b8fca91 req-9ef390b5-8d6f-4d94-a441-6b2114f4478e service nova] Creating event network-vif-plugged:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:05:22.549983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-fc1fcd52-63a4-453e-a97f-a4b88b8fca91 req-9ef390b5-8d6f-4d94-a441-6b2114f4478e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Jul 26 15:05:22.550581 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 545/1067] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:23.208225 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:23.208839 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:23.215651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.216164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.216951 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:23.217391 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:23.350109 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:23.357754 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d1abf11d-6f8e-484f-b6cd-45bb3be9a927 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.153758 Jul 26 15:05:23.358361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 523/1068] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:23 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:24.380902 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:24.381497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:24.388623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.389221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.390746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:24.391192 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:24.530083 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:24.538009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-03ab1dd2-ec29-4e26-942e-4ae25d9eb162 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1358 microversion: 2.1 time: 0.161547 Jul 26 15:05:24.538600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 546/1069] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:24 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:25.559814 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.560410 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:25.567842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.568285 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.569055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.569487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.709476 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:25.717709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6deb6de3-4dde-45d4-b8dd-da5701f8f8d0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1548 microversion: 2.1 time: 0.161954 Jul 26 15:05:25.718295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 524/1070] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:25.751943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.752554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:25.759193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.759683 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.760457 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.760896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.898118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:25.905680 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f7676085-8b42-4fe6-8d3a-bacbfdbee21d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1548 microversion: 2.1 time: 0.158230 Jul 26 15:05:25.906247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 547/1071] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:25.926134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:25.930961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:25.932411 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Searching by: {'deleted': False, 'project_id': 'd057f29b771a4110be66186949246663'} {{(pid=124888) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 15:05:25.940440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.940900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:25.941738 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:25.942182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.037591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.multi_cell_list [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124888) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 15:05:26.126012 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=100 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:26.143862 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9745328d-0336-4c4f-8617-bd968ead41d9 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221450 Jul 26 15:05:26.144487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 525/1072] 10.222.0.97 () {58 vars in 1125 bytes} [Tue Jul 26 15:05:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:26.156744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:26.157384 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:26.163964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.164417 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.165219 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:26.165637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:26.524457 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:26.526770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=100 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:26.533334 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4185cc7e-d081-4a23-a105-0a61d1e6c6ae tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1548 microversion: 2.1 time: 0.380643 Jul 26 15:05:26.533911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 548/1073] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:26 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1548 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:29.752030 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "746be55b-71ec-445b-b76e-c4610338660b"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:29.754334 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:29.761209 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.761654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:29.762421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:29.762859 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:30.764008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-73912a1d-b42a-4722-9cd6-563502f1ef6b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016324 Jul 26 15:05:30.765459 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 526/1074] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:05:29 2022] POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:39.423757 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:39.424368 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:39.426732 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=27 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:39.431711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.432160 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.432923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:39.433360 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:39.564409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:39.572551 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-da44f70f-ed74-4724-8a6f-22df61b8279b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1594 microversion: 2.1 time: 0.153242 Jul 26 15:05:39.573118 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 549/1075] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:39 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:05:41.647507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:41.648710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=31 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:41.649433 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:05:41.654244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-f61ae57a-b3cf-431f-a87d-df788ad702ca req-01dff301-d1e3-4b1a-9987-1d4cb951eca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:41.666070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f61ae57a-b3cf-431f-a87d-df788ad702ca req-01dff301-d1e3-4b1a-9987-1d4cb951eca7 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:41.666070 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f61ae57a-b3cf-431f-a87d-df788ad702ca req-01dff301-d1e3-4b1a-9987-1d4cb951eca7 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:41.681724 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-f61ae57a-b3cf-431f-a87d-df788ad702ca req-01dff301-d1e3-4b1a-9987-1d4cb951eca7 service nova] Creating event network-changed:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:05:41.686939 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-f61ae57a-b3cf-431f-a87d-df788ad702ca req-01dff301-d1e3-4b1a-9987-1d4cb951eca7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041057 Jul 26 15:05:41.687745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 527/1076] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:44.858822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1366881776"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:44.863927 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:44.866034 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.866478 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:44.867238 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:44.867699 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.001128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.network.security_group_api [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Adding security group 842a9ad9-e6c4-438e-b348-b4c56e62196e to port 2831923e-e6ab-4b89-a50e-076a3e488d88 Jul 26 15:05:45.497414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a220f436-e7ca-41b9-9194-ace6d1e561b8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action" status: 202 len: 0 microversion: 2.1 time: 0.642891 Jul 26 15:05:45.499638 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 550/1077] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 15:05:44 2022] POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:05:45.507965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:05:45.508507 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:05:45.523137 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-1b2cc289-2669-427c-a4d4-f2ab48e9b0a4 req-aa7bed01-d427-404c-b852-9534a6728034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:05:45.527913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.528372 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.530114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.531916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.544056 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1b2cc289-2669-427c-a4d4-f2ab48e9b0a4 req-aa7bed01-d427-404c-b852-9534a6728034 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:05:45.546530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1b2cc289-2669-427c-a4d4-f2ab48e9b0a4 req-aa7bed01-d427-404c-b852-9534a6728034 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:05:45.573892 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-1b2cc289-2669-427c-a4d4-f2ab48e9b0a4 req-aa7bed01-d427-404c-b852-9534a6728034 service nova] Creating event network-changed:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:05:45.584190 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-1b2cc289-2669-427c-a4d4-f2ab48e9b0a4 req-aa7bed01-d427-404c-b852-9534a6728034 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072438 Jul 26 15:05:45.594033 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 551/1078] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:05:45.824534 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:05:45.837625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-644a793f-fe13-47fa-8ac0-7c264b9fd576 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1760 microversion: 2.1 time: 0.333897 Jul 26 15:05:45.838632 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 528/1079] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:05:45 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1760 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:33.468795 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:33.469438 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:33.471568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:33.472228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=13 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:33.477414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.477875 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.478703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:33.479099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:33.501638 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5c94571b-56db-4680-bfb4-e4615df43053 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/ips" status: 200 len: 151 microversion: 2.20 time: 0.037964 Jul 26 15:06:33.502209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 552/1080] 10.222.0.97 () {60 vars in 1289 bytes} [Tue Jul 26 15:06:33 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:06:36.733688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:36.734283 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:36.736248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=4 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:36.736963 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=8 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:36.741992 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:36.742448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:36.743277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:36.743745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:36.766708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lazy-loading 'flavor' on Instance uuid 10e87418-f3e0-4162-bf2a-2ae8579091bb {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:06:37.336316 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ccfca585-fe82-46fa-9ad2-afe6b766934b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/action" status: 202 len: 0 microversion: 2.20 time: 0.607132 Jul 26 15:06:37.336920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 529/1081] 10.222.0.97 () {62 vars in 1319 bytes} [Tue Jul 26 15:06:36 2022] POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:06:37.345083 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:37.345698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:37.353243 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.358157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.358157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:37.358157 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:37.489174 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:37.497768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:37.499287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:37.500489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3d0774ea-7ea2-44d0-a764-328cd285640b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.159271 Jul 26 15:06:37.501051 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 553/1082] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:37 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:38.525946 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:38.527147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:38.533589 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.534042 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.534822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:38.535271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:38.673193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:38.681187 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:38.682716 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:38.683920 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-73e29ecb-a41b-4d59-9f53-5b1eaffabac9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.163224 Jul 26 15:06:38.684479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 530/1083] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:38 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:39.707921 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:39.708532 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:39.715835 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.716287 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.717053 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:39.717495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:39.850701 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:39.858814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:39.860354 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:39.861521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c7f059d8-3b46-4143-8533-c69ec44dbd34 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.157500 Jul 26 15:06:39.862080 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 554/1084] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:39 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:40.884471 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:40.885118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:40.892198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.892640 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:40.893396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:40.893851 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:41.032420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:41.040633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:41.042202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:41.043385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5ae2b597-1dff-4397-9f58-ad119c7d3686 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.162885 Jul 26 15:06:41.043969 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 531/1085] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:40 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:42.066490 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:42.067284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:42.075143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:42.075633 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:42.076449 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:42.076888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:42.209254 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:42.217490 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:42.219007 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:42.220226 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7918f8d1-06dc-4ea7-b558-d5c9ae3cbcaf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.157786 Jul 26 15:06:42.220770 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 555/1086] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:42 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:43.242591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:43.243157 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:43.250326 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.250768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.251557 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:43.251996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:43.390708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:43.399518 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:43.401464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:43.402332 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f10d992f-ce47-4963-a9d7-8bc6d470c149 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.163803 Jul 26 15:06:43.402898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 532/1087] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:43 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:44.354383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:44.356663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:44.364497 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.364957 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.365745 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.366189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.425994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:44.426626 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:44.433677 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.434125 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.434906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.435346 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.569773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.578745 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.580448 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.581902 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-38df9fc3-406f-4496-9341-df9c8b4b7b9c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.159619 Jul 26 15:06:44.582201 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 533/1088] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:44 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:06:44.624768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c51d2d7a-38d9-4a5c-b307-30f25fafe422 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action" status: 202 len: 0 microversion: 2.1 time: 0.274106 Jul 26 15:06:44.625626 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 556/1089] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 15:06:44 2022] POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:06:44.634048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:44.634768 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:44.641700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.642148 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.643351 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:44.643846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:44.794917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:44.803720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f606aeed-5473-4b3e-ac0d-28a731085ebc tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1752 microversion: 2.1 time: 0.173379 Jul 26 15:06:44.803966 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 534/1090] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:44 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:45.606081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:45.606783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:45.613406 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.613901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.614685 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.615128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.752098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.760897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.762431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.763663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fde1fa48-c22d-4a79-acc4-6ba9d9478f39 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.163114 Jul 26 15:06:45.764237 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 557/1091] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:45 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:45.824524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:45.825143 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:45.832685 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.833131 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.833908 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:45.834340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:45.981020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:45.991342 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ef318c92-a0f2-49fa-b6db-81cffb3939b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.170629 Jul 26 15:06:45.991996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 535/1092] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:45 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:46.787548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:46.788197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:46.794805 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.795249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.796047 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:46.796526 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:46.947963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:46.956127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:46.957640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:46.958802 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4279b0cf-8fcb-46b4-8fb3-94a03e701aed tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.175297 Jul 26 15:06:46.959365 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 558/1093] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:46 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:47.012956 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:47.013606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:47.020775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:47.021216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:47.022058 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:47.022541 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:47.170095 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:47.178536 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-68e256ea-e9d2-43c9-8cb6-6b6e92f2924e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.169502 Jul 26 15:06:47.179105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 536/1094] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:47 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:47.981260 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:47.981897 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:47.988394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:47.988843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:47.989602 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:47.990033 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.118430 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.126282 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.127804 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.128951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9d828706-b06c-4eec-8a32-2d0c21b626cc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.152098 Jul 26 15:06:48.129501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 559/1095] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:47 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:48.202122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:48.202733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:48.209701 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.210160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.210936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:48.211379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:48.358247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:48.366624 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d2e512a3-99c7-4a77-9050-c9dec0ce289a tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.169160 Jul 26 15:06:48.367211 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 537/1096] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:48 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:49.152751 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:49.153366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:49.159892 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.160349 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.161128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.161571 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.296710 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.304926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.306463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.307822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1f39c1f7-8fa0-4f3b-a7e8-c258bc4e42dd tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1744 microversion: 2.20 time: 0.159535 Jul 26 15:06:49.308423 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 560/1097] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:49 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:06:49.390600 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:49.391354 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:49.398773 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.399225 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.400018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:49.400450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:49.546450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:49.554456 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-04a71088-da80-424b-bc88-72c99dd6b3a1 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.169764 Jul 26 15:06:49.555024 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 538/1098] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:49 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:50.333508 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:50.334060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:50.341207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.341584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.342352 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.342791 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.473886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.482427 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.484005 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.485184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9203a78b-5699-4196-a8ee-bedc8d150765 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1744 microversion: 2.20 time: 0.155658 Jul 26 15:06:50.485738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 561/1099] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:50 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:50.576421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:50.577029 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:50.583575 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.583972 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.584740 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:50.585175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:50.778393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:50.786365 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8c48d9ed-00ca-4246-a90f-e6ab70fc6144 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.213852 Jul 26 15:06:50.786929 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 539/1100] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:50 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:51.508687 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.509312 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.515838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.516304 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.517094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.517538 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.652382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.660755 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.662345 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.663698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8a4053f3-90f2-44fb-9f1a-93d14bc3c020 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1744 microversion: 2.20 time: 0.159472 Jul 26 15:06:51.664298 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 562/1101] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:51.808645 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:51.809359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:51.815762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.816217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.816994 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:51.817434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:51.960164 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:51.968815 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e1779161-1140-4b7b-bd88-18bd6fca1ae0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.164309 Jul 26 15:06:51.969388 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 540/1102] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:51 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:52.690554 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:52.691158 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:52.698297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.698746 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.699540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:52.699978 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:52.832867 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:52.840871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:52.842321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:52.843505 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b69860fd-67e3-483c-8d70-ce7bf730903b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1744 microversion: 2.20 time: 0.156911 Jul 26 15:06:52.844063 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 563/1103] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:52 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:52.996922 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:52.998020 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.009901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.010704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.012193 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.013001 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.132949 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-0f645c67-28cc-45ed-9e5d-9006eef20067 req-2fe0ebae-5398-48ad-9fcf-6ed98fd73754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "name": "network-vif-plugged", "status": "completed", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:06:53.147630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0f645c67-28cc-45ed-9e5d-9006eef20067 req-2fe0ebae-5398-48ad-9fcf-6ed98fd73754 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.148189 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-0f645c67-28cc-45ed-9e5d-9006eef20067 req-2fe0ebae-5398-48ad-9fcf-6ed98fd73754 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.161069 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-0f645c67-28cc-45ed-9e5d-9006eef20067 req-2fe0ebae-5398-48ad-9fcf-6ed98fd73754 service nova] Creating event network-vif-plugged:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:06:53.167468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-0f645c67-28cc-45ed-9e5d-9006eef20067 req-2fe0ebae-5398-48ad-9fcf-6ed98fd73754 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038558 Jul 26 15:06:53.168440 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 564/1104] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:06:53.193266 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:53.204011 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-6b0a56c3-b225-4902-b626-44cc3f1ab723 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.214948 Jul 26 15:06:53.204635 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 541/1105] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:52 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:53.867552 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:53.868236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:53.875151 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.875655 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:53.876431 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:53.876870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.008477 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.016350 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.017856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.019026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-32cc6a5d-591c-4c72-9303-ca7e70145d79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1744 microversion: 2.20 time: 0.156297 Jul 26 15:06:54.019868 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 565/1106] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:53 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:54.226110 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:54.226640 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:54.233529 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.239984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.239984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:54.239984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:54.394046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:54.402471 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-062c54b4-3bc9-4ddc-8333-50afd448101e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.180561 Jul 26 15:06:54.403038 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 542/1107] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:54 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:55.045929 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:55.046678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:55.055471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.055471 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.056228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.056793 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.194165 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.205568 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.222848 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.222848 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ee5d09e9-065d-4390-b192-2ed766128ddf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.170222 Jul 26 15:06:55.222848 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 566/1108] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:55 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:06:55.429594 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:55.430563 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:55.437582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.438037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.438858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:55.439303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:55.459990 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:55.617182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:55.624954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4837197e-6bb2-4171-9b92-34cf5edbb9bd tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1757 microversion: 2.1 time: 0.199251 Jul 26 15:06:55.625525 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 543/1109] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:55 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:56.243470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.245639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.253707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.254207 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.255058 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.255558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.468938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.477931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.479563 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.480798 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fc7139dd-9e14-4b9d-b790-800dfd428c7f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.244313 Jul 26 15:06:56.481366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 567/1110] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:56.649085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:56.649733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:56.657527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.675938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.675938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:56.675938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:56.850105 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:56.863115 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ebb46c05-0ff4-4846-8447-506b1939fc47 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1760 microversion: 2.1 time: 0.218615 Jul 26 15:06:56.864384 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 544/1111] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:06:56 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1760 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:06:57.504533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:57.506094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:57.513088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.513865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.514864 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:57.515661 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:57.536978 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:06:57.678926 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.695631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.697729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:57.699211 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-5e9860d7-17c9-479a-9c60-a4d52d2fb248 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.198553 Jul 26 15:06:57.700472 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 568/1112] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:57 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:58.724185 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:58.724778 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:58.732918 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.733368 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.734160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:58.734595 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:58.882834 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.891866 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.893393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:06:58.894867 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-94f6ddd2-753c-4ed9-a2c4-714aab699ab6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.175159 Jul 26 15:06:58.895541 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 545/1113] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:58 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:06:59.919786 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:06:59.920517 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:06:59.929664 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.930163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:06:59.930959 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:06:59.931987 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:00.101536 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.117465 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.120279 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:00.121530 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0c8c0355-7179-4709-9839-c0cfba1832df tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.206435 Jul 26 15:07:00.122322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 569/1114] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:06:59 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:01.148344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:01.148344 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:01.159947 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.160382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.161160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:01.161604 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:01.362139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.372615 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.376330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:01.377613 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d159ae2e-997e-4ecf-81d6-3ce11e3f9051 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.235755 Jul 26 15:07:01.395828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 546/1115] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:01 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:02.407022 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:02.407668 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:02.414821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.415127 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.416567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:02.417156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:02.479846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:07:02.480369 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:07:02.668716 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.677945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.679518 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:02.680891 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e65e0589-4f54-47e2-9ee5-75971754597f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.278057 Jul 26 15:07:02.695426 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 570/1116] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:02 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:07:02.737754 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:07:02.737993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:07:03.709225 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:03.710464 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:03.727629 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.728770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.729689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:03.730160 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:03.893556 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:03.911531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:03.914720 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:03.917673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5ee2c1d4-aebc-4173-bb72-0005800fd8ff tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.216444 Jul 26 15:07:03.919436 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 547/1117] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:03 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:04.942209 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:04.942824 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:04.950269 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:04.951128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:04.951985 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:04.952740 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:05.113560 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.123361 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.124917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:05.126402 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-07baf1eb-f3af-4950-809d-09d85486e474 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.188626 Jul 26 15:07:05.127168 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 571/1118] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:04 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:05.969949 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:07:05.970618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:07:06.150421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:06.151039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:06.157938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.158506 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.159301 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:06.159818 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:06.304177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.318450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.319991 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:06.321181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-519fd583-70bc-4f31-aa9c-7fe4e570826c tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.174738 Jul 26 15:07:06.322314 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 548/1119] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:06 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:07.344769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:07.345393 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:07.352212 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.353149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.354000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:07.354440 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:07.507149 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.515888 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.517333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:07.518535 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-acc7303e-7317-4f38-9cab-08a0e2dfba61 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1739 microversion: 2.20 time: 0.177762 Jul 26 15:07:07.519358 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 572/1120] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:07 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:08.544578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:08.548825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:08.548825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=41 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:08.552726 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.553664 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.554052 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:08.554780 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:08.784319 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:08.793395 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:08.800758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:08.800758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e1343e7e-5ecb-48d6-a0ec-2449c8546b19 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1721 microversion: 2.20 time: 0.255627 Jul 26 15:07:08.800758 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 549/1121] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:08 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:07:09.821822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:09.822464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:09.824858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=43 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:09.832584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.833253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.834328 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:09.834794 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:09.981414 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.992476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.995584 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:09.997418 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4d10cad4-c23d-49af-8ae7-0fe1e87172c3 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1721 microversion: 2.20 time: 0.179472 Jul 26 15:07:09.997997 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 573/1122] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:09 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:11.021293 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:11.021938 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:11.029146 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.029599 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.030385 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:11.030825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:11.165945 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:11.174336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:11.175860 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:11.177017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9bfdee09-0e95-4250-b904-2d90762dd6a5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1721 microversion: 2.20 time: 0.159909 Jul 26 15:07:11.177570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 550/1123] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:11 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:12.205464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:12.206706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.217986 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.218717 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.220099 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.220885 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.367931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.376806 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.378405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:12.379738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ed1efecf-e259-4ee3-a040-e8a0404abc49 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1724 microversion: 2.20 time: 0.181800 Jul 26 15:07:12.380294 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 574/1124] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:12 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:12.402697 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c411919-c59f-4557-9b22-8073a2ccdfc5"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:12.405188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:12.412091 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.412548 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:12.413331 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:12.413770 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.237899 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-921eb651-35c9-4d95-ad79-dfb34b11c0fa req-f80c2b0b-c5a5-42d3-afb1-e78f64acd853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "name": "network-vif-unplugged", "status": "completed", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:13.248289 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-921eb651-35c9-4d95-ad79-dfb34b11c0fa req-f80c2b0b-c5a5-42d3-afb1-e78f64acd853 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.248706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-921eb651-35c9-4d95-ad79-dfb34b11c0fa req-f80c2b0b-c5a5-42d3-afb1-e78f64acd853 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.260865 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.compute.server_external_events [req-921eb651-35c9-4d95-ad79-dfb34b11c0fa req-f80c2b0b-c5a5-42d3-afb1-e78f64acd853 service nova] Unable to find a host for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb. Dropping event network-vif-unplugged {{(pid=124889) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 15:07:13.261765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-921eb651-35c9-4d95-ad79-dfb34b11c0fa req-f80c2b0b-c5a5-42d3-afb1-e78f64acd853 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027839 Jul 26 15:07:13.262362 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 575/1125] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 15:07:13.596123 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-83cf1c08-dc8c-4d32-bc13-096e515e2db9 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.197358 Jul 26 15:07:13.596783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 551/1126] 10.222.0.97 () {62 vars in 1364 bytes} [Tue Jul 26 15:07:12 2022] POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments => generated 188 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 15:07:13.724858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:13.725405 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:13.732313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.732765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:13.733532 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:13.733973 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.504178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-3a91794a-54fc-4d14-ac3e-361c2af04d4d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments/2c411919-c59f-4557-9b22-8073a2ccdfc5" status: 202 len: 0 microversion: 2.20 time: 0.783096 Jul 26 15:07:14.504854 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 576/1127] 10.222.0.97 () {60 vars in 1457 bytes} [Tue Jul 26 15:07:13 2022] DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments/2c411919-c59f-4557-9b22-8073a2ccdfc5 => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:07:14.570648 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:14.571249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:14.577916 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.578362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.579195 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.579668 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.854248 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-4b18cc2e-0e3d-4d39-97aa-882a1648f506 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/action" status: 202 len: 0 microversion: 2.20 time: 0.287462 Jul 26 15:07:14.854962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 552/1128] 10.222.0.97 () {62 vars in 1319 bytes} [Tue Jul 26 15:07:14 2022] POST /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:07:14.863342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:14.866707 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:14.870386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.870839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:14.871754 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:14.872195 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:15.014778 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.024814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.026832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:15.027763 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8a8268b2-9c56-4b46-839d-462c76c2a7f8 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1672 microversion: 2.20 time: 0.168567 Jul 26 15:07:15.028329 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 577/1129] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:14 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:16.051079 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:16.051817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:16.058162 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.058684 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.059550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:16.060056 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:16.199017 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.208116 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.209638 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:16.210827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ee5e6d6d-4cf1-4ee4-97a9-7522e9412f41 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1672 microversion: 2.20 time: 0.164320 Jul 26 15:07:16.211376 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 553/1130] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:16 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:17.234706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:17.235259 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:17.242177 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.242631 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.244037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:17.244476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:17.380059 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.388814 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.390346 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:17.391599 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1d9fe04a-2979-46cf-9220-75ce85ac8ef7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.161105 Jul 26 15:07:17.392161 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 578/1131] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:17 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:18.415683 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:18.416294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:18.423218 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.423694 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.424470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:18.424999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:18.574967 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.583375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.584914 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:18.586139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f18e6832-24b7-40d4-8254-e3c0f3674dc6 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.174466 Jul 26 15:07:18.587462 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 554/1132] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:18 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:19.609758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:19.611935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:19.617128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.617579 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.618395 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:19.618836 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:19.767249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.776416 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.777903 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:19.779086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a103831f-8ece-4077-adde-46acd2307bfb tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.173285 Jul 26 15:07:19.779682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 579/1133] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:19 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:20.803779 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:20.805855 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:20.813410 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.814244 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.815276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:20.815999 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:20.979006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.987538 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.989158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:20.991289 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-65f89cb2-b663-4439-a367-c6d1cbfbf734 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.191156 Jul 26 15:07:20.996444 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 555/1134] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:20 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:22.014466 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:22.015187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:22.022124 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.022581 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.023373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:22.023832 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:22.183679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.192074 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.193766 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:22.195077 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-54e6d253-b100-40a2-b84c-a0d8deaf257b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.184911 Jul 26 15:07:22.195797 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 580/1135] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:22 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:23.219217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:23.219861 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:23.226612 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.227068 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.227982 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:23.228581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:23.251156 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:23.382122 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.391502 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.393021 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:23.394511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-deea94b1-cd6d-41ea-ad9e-dba4b3f24dbc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.179620 Jul 26 15:07:23.395239 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 556/1136] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:23 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:24.417925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:24.418628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:24.427085 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.427665 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.428543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:24.429075 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:24.575614 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.585322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.587858 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:24.589392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dc552cf8-6c5e-4e73-a164-d7e000a80e4b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.175842 Jul 26 15:07:24.602901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 581/1137] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:24 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:25.613625 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:25.614415 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:25.621375 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.621828 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.622609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:25.623063 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:25.781585 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.790345 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.791887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:25.793053 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e2d10308-824a-4ead-b204-a0bbba62fbd1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.183374 Jul 26 15:07:25.793825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 557/1138] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:25 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:26.822015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:26.823291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:26.833911 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.834698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.836645 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:26.837410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:26.999684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.010032 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.012663 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:27.013734 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f6f17f80-46b7-4273-9959-343e212d4a90 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.198843 Jul 26 15:07:27.013915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 582/1139] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:26 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:28.038261 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:28.038915 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:28.046173 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.046654 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:28.047531 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:28.048008 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:28.182961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:28.191689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:28.193251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:28.194408 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f1728daf-5e1a-482e-bfb2-4de922710ed5 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.160117 Jul 26 15:07:28.194962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 558/1140] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:28 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:29.217522 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:29.218105 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:29.224735 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.225183 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.225948 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:29.226382 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:29.229548 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:29.367214 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:29.375386 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:29.376953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:29.379510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-44e6c22c-2613-4467-b493-0187cd14a7cf tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.164646 Jul 26 15:07:29.379510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 583/1141] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:29 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:30.401498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:30.402154 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:30.408733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:30.409184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:30.409960 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:30.410425 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:30.549666 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:30.557700 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:30.559222 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:30.560424 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-2570f48b-f534-4c3d-8d07-503b2c3a7c79 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.163576 Jul 26 15:07:30.560984 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 559/1142] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:30 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:31.584291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:31.584980 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:31.591830 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.592332 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.593146 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:31.593589 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:31.946184 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.955501 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.957011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:31.958185 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-4be3e751-ac44-4351-8880-33d1754a88c1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.378252 Jul 26 15:07:31.958764 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 584/1143] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:31 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 15:07:32.981921 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:32.982548 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:32.989769 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.990241 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:32.991013 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:32.991474 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:33.126468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:33.135249 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:33.136822 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:33.138006 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-adffac74-fca0-43c2-9d57-39cf448c83fc tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.160188 Jul 26 15:07:33.138577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 560/1144] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:32 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:34.162134 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:34.162943 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:34.170729 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.179014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.179014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:34.179014 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:34.313843 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:34.322291 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:34.323811 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:34.324950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bc302d94-449b-41d6-bc70-ef1a4bfb9f16 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.166867 Jul 26 15:07:34.325507 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 585/1145] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:34 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:35.348343 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:35.349057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:35.357147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:35.357606 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:35.358407 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:35.358841 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:35.392120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-1ae3ed75-2d4c-42f2-ba8a-d52f32686b0c req-087f4f0e-2019-45ef-9f2f-b4b0ed1e07bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "name": "network-vif-plugged", "status": "completed", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:07:35.403490 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1ae3ed75-2d4c-42f2-ba8a-d52f32686b0c req-087f4f0e-2019-45ef-9f2f-b4b0ed1e07bb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:35.410167 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1ae3ed75-2d4c-42f2-ba8a-d52f32686b0c req-087f4f0e-2019-45ef-9f2f-b4b0ed1e07bb service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:35.415841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-1ae3ed75-2d4c-42f2-ba8a-d52f32686b0c req-087f4f0e-2019-45ef-9f2f-b4b0ed1e07bb service nova] Creating event network-vif-plugged:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:07:35.420856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-1ae3ed75-2d4c-42f2-ba8a-d52f32686b0c req-087f4f0e-2019-45ef-9f2f-b4b0ed1e07bb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Jul 26 15:07:35.421476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 586/1146] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:07:35.504582 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:35.516873 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:35.524997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:35.524997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f5c2b83e-815f-4b7f-9616-0a2e71fd118b tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.177032 Jul 26 15:07:35.524997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 561/1147] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:35 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:36.549159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:36.549853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:36.557017 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.557468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.558253 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:36.558692 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:36.697514 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:36.705545 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:36.707091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:36.708283 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c69023c1-8455-469a-9fd3-eb343063325d tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.163986 Jul 26 15:07:36.708847 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 587/1148] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:36 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:37.732475 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:37.733066 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:37.739723 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:37.740182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:37.740952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:37.741387 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:37.878514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:37.887796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:37.889367 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:37.890558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f41a40b4-c360-45fe-9e58-9969a8a36c29 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.161989 Jul 26 15:07:37.891118 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 562/1149] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:37 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:38.914654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:38.915193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:38.921875 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.922425 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:38.923314 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:38.923776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:39.056301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:39.064917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:39.066499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:39.067773 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8f901386-b2f1-45ea-aa71-223eb549e75e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1730 microversion: 2.20 time: 0.157583 Jul 26 15:07:39.068334 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 588/1150] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:38 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:07:40.091520 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:07:40.092134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:07:40.094468 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=30 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:07:40.099235 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:40.099731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:40.100505 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:07:40.101578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:07:40.233198 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:40.241129 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:40.242637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:07:40.243825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-d3e35c66-643c-4fae-a830-03ee363b9886 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1717 microversion: 2.20 time: 0.156280 Jul 26 15:07:40.244409 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 563/1151] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:07:40 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:08:04.023988 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1366881776"}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:04.024628 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:04.026603 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=31 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:04.027262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=31 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:04.032060 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.032509 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.033270 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.033703 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.168132 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.network.security_group_api [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Removing security group 842a9ad9-e6c4-438e-b348-b4c56e62196e from port 2831923e-e6ab-4b89-a50e-076a3e488d88 Jul 26 15:08:04.592964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a5bd83e0-0f75-4a0e-af5e-079e83a25bd8 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action" status: 202 len: 0 microversion: 2.1 time: 0.573089 Jul 26 15:08:04.597247 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-762578c5-0ab9-4fb3-90a9-3a27f6600240 req-1c04dd4d-e840-4118-ba00-3496d4c881ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:04.598078 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 589/1152] 10.222.0.97 () {60 vars in 1278 bytes} [Tue Jul 26 15:08:04 2022] POST /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:04.618950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:04.619711 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=44 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:04.626803 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-762578c5-0ab9-4fb3-90a9-3a27f6600240 req-1c04dd4d-e840-4118-ba00-3496d4c881ef service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:04.631821 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-762578c5-0ab9-4fb3-90a9-3a27f6600240 req-1c04dd4d-e840-4118-ba00-3496d4c881ef service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:04.644393 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-762578c5-0ab9-4fb3-90a9-3a27f6600240 req-1c04dd4d-e840-4118-ba00-3496d4c881ef service nova] Creating event network-changed:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:08:04.663048 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-762578c5-0ab9-4fb3-90a9-3a27f6600240 req-1c04dd4d-e840-4118-ba00-3496d4c881ef service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069822 Jul 26 15:08:04.668730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 564/1153] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:06.117182 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:06.117861 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:06.124164 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.124623 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.125403 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.125841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.219052 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lazy-loading 'services' on Instance uuid 76622244-1b87-4bef-abec-7e54b6e9682e {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:08:06.531231 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a9b1e82a-5582-4aa8-8216-7e9b5ba4c636 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments/746be55b-71ec-445b-b76e-c4610338660b" status: 202 len: 0 microversion: 2.1 time: 0.418550 Jul 26 15:08:06.544928 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 590/1154] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:08:06 2022] DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments/746be55b-71ec-445b-b76e-c4610338660b => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:06.545245 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:06.550287 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:06.557996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.557996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.558801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.559245 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.590577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-98fc29ff-4ff0-498b-901f-c3fb5631e08b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053782 Jul 26 15:08:06.596618 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 565/1155] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:08:06 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:06.683306 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-185b504f-83cb-46f8-ace7-e9d9251c230a req-91a7f848-2ce5-4a2d-a78a-4345781997bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:06.694392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-185b504f-83cb-46f8-ace7-e9d9251c230a req-91a7f848-2ce5-4a2d-a78a-4345781997bf service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:06.694841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-185b504f-83cb-46f8-ace7-e9d9251c230a req-91a7f848-2ce5-4a2d-a78a-4345781997bf service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:06.707500 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-185b504f-83cb-46f8-ace7-e9d9251c230a req-91a7f848-2ce5-4a2d-a78a-4345781997bf service nova] Creating event network-changed:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:08:06.713464 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-185b504f-83cb-46f8-ace7-e9d9251c230a req-91a7f848-2ce5-4a2d-a78a-4345781997bf service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Jul 26 15:08:06.714198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 591/1156] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:07.607106 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:07.609528 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:07.616280 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.616734 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.617527 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:07.618155 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:07.649952 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-172f54d3-1985-460c-9169-fa6c26eeec85 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Jul 26 15:08:07.650776 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 566/1157] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:08:07 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:08.663923 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:08.666138 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:08.672316 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.672799 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.673531 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.673965 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.703894 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-c8b64cd1-85ba-4e47-bc90-af13cf133780 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045249 Jul 26 15:08:08.704482 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 592/1158] 10.222.0.97 () {58 vars in 1302 bytes} [Tue Jul 26 15:08:08 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 15:08:08.714929 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:08.715450 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:08.722009 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.722486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.723257 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:08.723820 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:08.800083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] HTTP exception thrown: Instance 76622244-1b87-4bef-abec-7e54b6e9682e is not attached to volume 746be55b-71ec-445b-b76e-c4610338660b Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Request method failure captured: Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments/746be55b-71ec-445b-b76e-c4610338660b HTTP/1.1 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AKClrQM0J1MLPWWG6nuQtymKVb1Gekuulgi8_g2pl1yU9eFtG3pb-TwXIQssN9L8ucoG7qh49Aia5qJlQY11sJT3oGTpDtBknuLV77evfTsvzeqxqOimoec7erq--OmciMNPcgOf8qfPSxZX_2MyMIH3rZSfu0hHwjVSfpaeMGMlAA Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: d057f29b771a4110be66186949246663 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:08:08.803055 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_d057f29b771a4110be66186949246663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d057f29b771a4110be66186949246663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d057f29b771a4110be66186949246663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/d057f29b771a4110be66186949246663"}]}] Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: d057f29b771a4110be66186949246663 Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-TestMinimumBasicScenario-2094516089-project Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 7338eed24b4a42208d4395e93d464d65 Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-TestMinimumBasicScenario-2094516089-project Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:08:08.804764 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 76622244-1b87-4bef-abec-7e54b6e9682e is not attached to volume 746be55b-71ec-445b-b76e-c4610338660b Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'server_id': '76622244-1b87-4bef-abec-7e54b6e9682e', 'id': '746be55b-71ec-445b-b76e-c4610338660b'} Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 746be55b-71ec-445b-b76e-c4610338660b. Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:08.805609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76622244-1b87-4bef-abec-7e54b6e9682e is not attached to volume 746be55b-71ec-445b-b76e-c4610338660b Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76622244-1b87-4bef-abec-7e54b6e9682e is not attached to volume 746be55b-71ec-445b-b76e-c4610338660b Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:08.806943 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Returning 404 to user: Instance 76622244-1b87-4bef-abec-7e54b6e9682e is not attached to volume 746be55b-71ec-445b-b76e-c4610338660b {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:08.807961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-e9d91cf5-8dd1-438d-bdbb-ae187d1104f7 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments/746be55b-71ec-445b-b76e-c4610338660b" status: 404 len: 154 microversion: 2.1 time: 0.093669 Jul 26 15:08:08.807961 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 567/1159] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:08:08 2022] DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e/os-volume_attachments/746be55b-71ec-445b-b76e-c4610338660b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:08:10.120400 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:10.120904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:10.127495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.127956 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.128724 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.129163 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.157262 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Going to try to terminate instance {{(pid=124889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:08:10.537828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-003d16c4-7b21-4453-9837-13205694a9c4 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 204 len: 0 microversion: 2.1 time: 0.420472 Jul 26 15:08:10.538418 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 593/1160] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:08:10 2022] DELETE /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:08:10.546736 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:10.547484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:10.554382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.554845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.555651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:10.556095 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:10.686919 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:10.694511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-136183fe-52da-47c8-b629-27b362a8f4b0 tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1554 microversion: 2.1 time: 0.151806 Jul 26 15:08:10.695080 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 568/1161] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:10 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:11.717761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:11.718484 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:11.725104 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.725594 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.726373 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:11.726822 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:11.859925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:11.868455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fe5ebbc4-43b9-4b01-94da-9c28ee352c8b tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1554 microversion: 2.1 time: 0.155054 Jul 26 15:08:11.869037 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 594/1162] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:11 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:12.890123 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:12.890868 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:12.898132 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.898570 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:12.899350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:12.899877 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.150253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:13.157955 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-348116b7-69c6-4682-bb48-69d34952df7e tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1554 microversion: 2.1 time: 0.271722 Jul 26 15:08:13.158550 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 569/1163] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:12 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1554 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:13.519081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [req-1b9be6e8-1176-4643-b118-4ed71c0ad4e7 req-7801d62b-294d-433c-b857-29e12e69f4ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76622244-1b87-4bef-abec-7e54b6e9682e", "name": "network-vif-deleted", "tag": "2831923e-e6ab-4b89-a50e-076a3e488d88"}]} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:13.529733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1b9be6e8-1176-4643-b118-4ed71c0ad4e7 req-7801d62b-294d-433c-b857-29e12e69f4ee service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:13.531692 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [req-1b9be6e8-1176-4643-b118-4ed71c0ad4e7 req-7801d62b-294d-433c-b857-29e12e69f4ee service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:13.544096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.compute.server_external_events [req-1b9be6e8-1176-4643-b118-4ed71c0ad4e7 req-7801d62b-294d-433c-b857-29e12e69f4ee service nova] Creating event network-vif-deleted:2831923e-e6ab-4b89-a50e-076a3e488d88 for instance 76622244-1b87-4bef-abec-7e54b6e9682e on hv-cinder-85103 Jul 26 15:08:13.548916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [req-1b9be6e8-1176-4643-b118-4ed71c0ad4e7 req-7801d62b-294d-433c-b857-29e12e69f4ee service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033911 Jul 26 15:08:13.549515 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 595/1164] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:14.179901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:14.180577 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:14.187227 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.195294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.195294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.195294 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.224215 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:14.224842 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:14.225434 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.objects.instance [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lazy-loading 'fault' on Instance uuid 76622244-1b87-4bef-abec-7e54b6e9682e {{(pid=124888) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:08:14.268340 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7338eed24b4a42208d4395e93d464d65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd057f29b771a4110be66186949246663', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:14.276147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-06eeaec6-8d76-489c-bbef-364aab97d7cf tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 200 len: 1348 microversion: 2.1 time: 0.100180 Jul 26 15:08:14.276778 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 570/1165] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:14 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:08:15.299470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:15.300198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] [instance: 76622244-1b87-4bef-abec-7e54b6e9682e] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:15.306489 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:15.306954 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:15.307758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:15.308200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:15.321435 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] HTTP exception thrown: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Request method failure captured: Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e HTTP/1.1 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AKClrQM0J1MLPWWG6nuQtymKVb1Gekuulgi8_g2pl1yU9eFtG3pb-TwXIQssN9L8ucoG7qh49Aia5qJlQY11sJT3oGTpDtBknuLV77evfTsvzeqxqOimoec7erq--OmciMNPcgOf8qfPSxZX_2MyMIH3rZSfu0hHwjVSfpaeMGMlAA Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: d057f29b771a4110be66186949246663 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:08:15.327268 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_d057f29b771a4110be66186949246663"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d057f29b771a4110be66186949246663"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/d057f29b771a4110be66186949246663"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/d057f29b771a4110be66186949246663"}]}] Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: d057f29b771a4110be66186949246663 Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2094516089 Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-TestMinimumBasicScenario-2094516089-project Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: 7338eed24b4a42208d4395e93d464d65 Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-TestMinimumBasicScenario-2094516089-project Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. Jul 26 15:08:15.328884 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '76622244-1b87-4bef-abec-7e54b6e9682e'} Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:15.329818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. Jul 26 15:08:15.331321 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:15.332808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Returning 404 to user: Instance 76622244-1b87-4bef-abec-7e54b6e9682e could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:15.332808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bff33298-e2cf-40a9-9102-a41071f30f5d tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e" status: 404 len: 111 microversion: 2.1 time: 0.030189 Jul 26 15:08:15.332808 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 596/1166] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:08:15 2022] GET /compute/v2.1/servers/76622244-1b87-4bef-abec-7e54b6e9682e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:08:15.334041 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-0e20d64a-09e9-466a-8d14-a4c2cf9109ee tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] Calling method '.version_select at 0x7f97e6178e50>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:15.509869 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-0e20d64a-09e9-466a-8d14-a4c2cf9109ee tempest-TestMinimumBasicScenario-2094516089 tempest-TestMinimumBasicScenario-2094516089-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-180171367" status: 202 len: 0 microversion: 2.1 time: 0.180190 Jul 26 15:08:15.510457 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 571/1167] 10.222.0.97 () {58 vars in 1269 bytes} [Tue Jul 26 15:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-180171367 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:35.772020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:35.774198 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:35.776558 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:35.777225 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:35.782009 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:35.782470 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:35.783255 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:35.783731 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:35.814297 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0ca0f6a1-8332-4e12-a976-7be5bb0b339f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046571 Jul 26 15:08:35.815052 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 597/1168] 10.222.0.97 () {60 vars in 1343 bytes} [Tue Jul 26 15:08:35 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:08:35.875710 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=40 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:35.877014 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:35.881141 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:35.888231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:35.888231 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:35.888488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:35.889216 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:35.889663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:35.918158 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:08:36.400517 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-dec2613f-31b9-4bf7-80b2-22be409ee9e1 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 204 len: 0 microversion: 2.20 time: 0.525904 Jul 26 15:08:36.401025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 572/1169] 10.222.0.97 () {60 vars in 1280 bytes} [Tue Jul 26 15:08:35 2022] DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:08:36.409267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:36.409840 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:36.417541 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:36.417993 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:36.418768 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:36.419200 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:36.553714 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:36.562325 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:36.566925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:36.566925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-71ab6a87-1858-4f51-b4bc-3025c329697f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.159712 Jul 26 15:08:36.566925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 598/1170] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:36 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:08:37.590046 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:37.590739 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:37.597514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:37.599823 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:37.599823 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:37.600054 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:37.732950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:37.741777 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:37.743383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:37.750496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7d06d878-6b7e-41ee-85f6-cdd2310a5b91 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1723 microversion: 2.20 time: 0.159212 Jul 26 15:08:37.750496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 573/1171] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:37 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:08:38.767913 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:38.768889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:38.776523 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:38.776975 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:38.777759 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:38.778201 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:38.850292 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:38.858948 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:38.860510 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:38.861713 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-203d02fd-c6b5-4a16-989b-85d0210b5b60 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1655 microversion: 2.20 time: 0.097963 Jul 26 15:08:38.862267 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 599/1172] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:38 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:08:39.484950 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-3a8f0c6b-de24-4f99-b82e-08fd1d52176e req-af39beeb-78e3-42dc-838b-29380d6bf152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e87418-f3e0-4162-bf2a-2ae8579091bb", "name": "network-vif-deleted", "tag": "c0142c69-b557-4895-8179-6c8e34d11416"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:39.495214 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-3a8f0c6b-de24-4f99-b82e-08fd1d52176e req-af39beeb-78e3-42dc-838b-29380d6bf152 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.495690 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-3a8f0c6b-de24-4f99-b82e-08fd1d52176e req-af39beeb-78e3-42dc-838b-29380d6bf152 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:39.507611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-3a8f0c6b-de24-4f99-b82e-08fd1d52176e req-af39beeb-78e3-42dc-838b-29380d6bf152 service nova] Creating event network-vif-deleted:c0142c69-b557-4895-8179-6c8e34d11416 for instance 10e87418-f3e0-4162-bf2a-2ae8579091bb on hv-cinder-85103 Jul 26 15:08:39.513002 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-3a8f0c6b-de24-4f99-b82e-08fd1d52176e req-af39beeb-78e3-42dc-838b-29380d6bf152 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223609 Jul 26 15:08:39.522472 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 574/1173] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:39.886682 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:39.887285 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:39.894284 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.894711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:39.895573 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.896011 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:39.929199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:39.929646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:39.930098 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lazy-loading 'fault' on Instance uuid 10e87418-f3e0-4162-bf2a-2ae8579091bb {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:08:39.977587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:39.986114 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:39.987708 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df675a52f9b245198897842f7a6ecd13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f82b8853b874e61820108bc16e8dc41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:08:39.988839 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b308b0c8-3748-4795-8294-667688a0995f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 200 len: 1371 microversion: 2.20 time: 0.106108 Jul 26 15:08:39.989427 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 600/1174] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:39 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 1371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 15:08:41.013511 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:41.014207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:41.021420 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:41.021887 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:41.022660 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:41.023111 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:41.036432 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb HTTP/1.1 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:08:41.038083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:41.039911 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '10e87418-f3e0-4162-bf2a-2ae8579091bb'} Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:41.040817 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:41.042361 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:41.043904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:41.043904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c506014d-de9a-4cd4-80e9-38ab6247522e tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 404 len: 111 microversion: 2.20 time: 0.030808 Jul 26 15:08:41.043904 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 575/1175] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:41 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:08:41.049026 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-41ff054f-afd6-4028-be2b-451c8410b2c7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '.version_select at 0x7f97e648f280>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:41.141587 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-41ff054f-afd6-4028-be2b-451c8410b2c7 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406812991" status: 204 len: 0 microversion: 2.20 time: 0.096650 Jul 26 15:08:41.142159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 601/1176] 10.222.0.97 () {60 vars in 1262 bytes} [Tue Jul 26 15:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1406812991 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 15:08:43.356653 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:43.357161 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:43.363728 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.364181 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.364953 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.365396 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.379228 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb HTTP/1.1 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:08:43.381299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.382965 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '10e87418-f3e0-4162-bf2a-2ae8579091bb'} Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:43.384067 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.385705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.387381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:43.387381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8f0b4ac1-4f86-4daa-af6c-5499ff153cb4 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 404 len: 111 microversion: 2.20 time: 0.029900 Jul 26 15:08:43.387381 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 576/1177] 10.222.0.97 () {60 vars in 1280 bytes} [Tue Jul 26 15:08:43 2022] DELETE /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:08:43.391917 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:43.392539 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: 10e87418-f3e0-4162-bf2a-2ae8579091bb] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:43.400249 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.400698 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.401476 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:43.401915 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:43.415896 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb HTTP/1.1 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:08:43.417467 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.418937 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': '10e87418-f3e0-4162-bf2a-2ae8579091bb'} Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:43.419869 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. Jul 26 15:08:43.421439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:43.422950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance 10e87418-f3e0-4162-bf2a-2ae8579091bb could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:43.422950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bb89c09c-6155-4915-bf98-e6dc32409702 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb" status: 404 len: 111 microversion: 2.20 time: 0.031382 Jul 26 15:08:43.422950 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 602/1178] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:43 2022] GET /compute/v2.1/servers/10e87418-f3e0-4162-bf2a-2ae8579091bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:08:44.735509 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:44.736078 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:44.742519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.742990 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:44.743778 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.744220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:44.758233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b HTTP/1.1 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:08:44.759837 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.761481 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'd566308c-cba6-4925-8ac6-820573486d4b'} Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:44.762426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.764196 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.765762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:44.765762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-325aca32-ea1b-4ef7-b9f4-5390ef4f1a2f tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 404 len: 111 microversion: 2.20 time: 0.029683 Jul 26 15:08:44.765762 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 577/1179] 10.222.0.97 () {60 vars in 1280 bytes} [Tue Jul 26 15:08:44 2022] DELETE /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:08:44.770124 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:44.770841 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] [instance: d566308c-cba6-4925-8ac6-820573486d4b] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:08:44.778305 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.778761 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:44.779576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:08:44.780020 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:08:44.793910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] HTTP exception thrown: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Request method failure captured: Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b HTTP/1.1 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AF8SJVACKoPXFzcndQpbXSAB20_Ixg2cbx2EZYFfqqiBO0cyv5nerkdOOtzQ4G7cHvOHsoFiKbKRX8p9UfMQvWetwZ9p978PgGSUH4FsB9K3hgW9aZPKf_kfV98-DzQhmhtW1n2yWhGyiMTNQGCAsoGI5dlefhuynuIYKI9vK9bS6k Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:08:44.795495 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/7f82b8853b874e61820108bc16e8dc41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/7f82b8853b874e61820108bc16e8dc41"}]}] Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: 7f82b8853b874e61820108bc16e8dc41 Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1675207022 Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: df675a52f9b245198897842f7a6ecd13 Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1675207022-project Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: > Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.797187 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'd566308c-cba6-4925-8ac6-820573486d4b'} Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:08:44.798159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. Jul 26 15:08:44.799744 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:08:44.801057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] Returning 404 to user: Instance d566308c-cba6-4925-8ac6-820573486d4b could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:08:44.801057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e821fdec-b937-433d-96b9-0be10d337821 tempest-AttachVolumeShelveTestJSON-1675207022 tempest-AttachVolumeShelveTestJSON-1675207022-project] 10.222.0.97 "GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b" status: 404 len: 111 microversion: 2.20 time: 0.031001 Jul 26 15:08:44.801057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 603/1180] 10.222.0.97 () {60 vars in 1277 bytes} [Tue Jul 26 15:08:44 2022] GET /compute/v2.1/servers/d566308c-cba6-4925-8ac6-820573486d4b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 15:08:51.013139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-86145e14-f421-474f-b128-fefbcf2c1c5e tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Action: 'create', calling method: .version_select at 0x7f97e63cdc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1484340711"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:51.774137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-86145e14-f421-474f-b128-fefbcf2c1c5e tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.877938 Jul 26 15:08:51.774801 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 578/1181] 10.222.0.97 () {60 vars in 1155 bytes} [Tue Jul 26 15:08:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 879 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 26 15:08:51.787012 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-0d3c5ac1-2633-4988-afce-b29413dc943e tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6552820>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:51.842003 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-0d3c5ac1-2633-4988-afce-b29413dc943e tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 200 len: 345 microversion: 2.1 time: 0.058378 Jul 26 15:08:51.843043 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 604/1182] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:08:51 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:52.858979 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-985c2437-cfa8-42ba-92fc-e140bacf7416 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97eabc1280>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:52.908303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-985c2437-cfa8-42ba-92fc-e140bacf7416 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 200 len: 345 microversion: 2.1 time: 0.053658 Jul 26 15:08:52.908868 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 579/1183] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:08:52 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:53.929473 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ce5efcac-17a2-4a55-b274-826bfa79c193 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e655de50>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:53.979810 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ce5efcac-17a2-4a55-b274-826bfa79c193 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 200 len: 346 microversion: 2.1 time: 0.057710 Jul 26 15:08:53.980375 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 605/1184] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:08:53 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:53.995708 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ff9af161-1004-40b2-b6e5-7705ecf7e78a tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Action: 'create', calling method: .version_select at 0x7f97e63cdc10>, body: {"snapshot": {"volume_id": "ef29b431-15d5-4539-8d84-ac56537c14a7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-795785366"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:08:54.532848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ff9af161-1004-40b2-b6e5-7705ecf7e78a tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.539188 Jul 26 15:08:54.532848 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 580/1185] 10.222.0.97 () {60 vars in 1162 bytes} [Tue Jul 26 15:08:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:54.542474 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cf1545da-873f-46a9-9083-356b2c15932f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6451c10>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:54.573313 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cf1545da-873f-46a9-9083-356b2c15932f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.034552 Jul 26 15:08:54.573940 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 606/1186] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:54 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:54.585731 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ac228fb7-00b5-41fa-8d04-9acf6507f2ba tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6414d30>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:54.616657 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ac228fb7-00b5-41fa-8d04-9acf6507f2ba tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.035533 Jul 26 15:08:54.617230 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 581/1187] 10.222.0.97 () {58 vars in 1140 bytes} [Tue Jul 26 15:08:54 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:54.628533 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-7774583c-02e9-4da5-9c97-6e30ea350e23 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97eab4a0d0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:54.659889 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-7774583c-02e9-4da5-9c97-6e30ea350e23 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.035375 Jul 26 15:08:54.660463 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 607/1188] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:54 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:08:55.671102 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:55.671901 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:55.676150 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5b80321d-abe6-49f6-8e55-1bd1b9dc8b5a tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6499b80>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:55.705854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5b80321d-abe6-49f6-8e55-1bd1b9dc8b5a tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.035519 Jul 26 15:08:55.706421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 582/1189] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:55 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:56.715711 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:56.716487 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=30 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:08:56.720733 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-1a9df4b6-de38-4db3-9ef9-7be6a6f3431f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6552040>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:56.750721 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-1a9df4b6-de38-4db3-9ef9-7be6a6f3431f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.035635 Jul 26 15:08:56.751322 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 608/1190] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:56 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:57.765084 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-773a1a31-5f02-4890-9a65-38ad316478ef tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97eabc1670>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:57.798673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-773a1a31-5f02-4890-9a65-38ad316478ef tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.038306 Jul 26 15:08:57.799281 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 583/1191] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:57 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:58.810755 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-b503a511-0282-43dc-a7a4-951ad4d86360 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6451d30>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:58.844742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-b503a511-0282-43dc-a7a4-951ad4d86360 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 287 microversion: 2.1 time: 0.038197 Jul 26 15:08:58.845337 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 609/1192] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:58 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:08:58.858259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b4021b68-e725-43f9-bbd7-b783b12ea993 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e61e8b80>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.001276 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b4021b68-e725-43f9-bbd7-b783b12ea993 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "DELETE /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 202 len: 0 microversion: 2.1 time: 0.148027 Jul 26 15:08:59.001845 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 584/1193] 10.222.0.97 () {58 vars in 1254 bytes} [Tue Jul 26 15:08:58 2022] DELETE /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:08:59.011632 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-145c5a6f-7593-4c6a-9745-fb3d0a68a4f9 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e648f430>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:08:59.042828 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-145c5a6f-7593-4c6a-9745-fb3d0a68a4f9 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 200 len: 286 microversion: 2.1 time: 0.035782 Jul 26 15:08:59.043459 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 610/1194] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:08:59 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:09:00.057057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ec3a862b-074c-4c42-8cd3-5422524c171f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e611f790>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.084663 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-ec3a862b-074c-4c42-8cd3-5422524c171f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] HTTP exception thrown: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ec3a862b-074c-4c42-8cd3-5422524c171f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Request method failure captured: Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c HTTP/1.1 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AOCxE7sOHRoL3O6mgmm_xmpry8wE_8Qfcrvzb1ZLN6xGgZxMMghieA-2RhuEGXmM0-BmNH6DYRWJxn7pGPT78svEdniQ_nZyNvrE_YQ5CCFLeMUQ2_08gi9X3kp9mj6KUebUJ238Ip2JRy-HVqtHAp1_CaZ0wRvwKUB6iSOAKJaqbI Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:09:00.087047 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/e06910a243dd43d7976f10a6b87dba00"}]}] Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: efbd1801fa1f42cc8e279152c2e036d2 Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '297d1dca-6230-4bb7-900e-d859da433a6c'} Jul 26 15:09:00.088524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. (HTTP 404) (Request-ID: req-828c163a-c4ef-4efe-886e-c9e386c9c998) Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.089508 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:00.090785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 15:09:00.092036 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-ec3a862b-074c-4c42-8cd3-5422524c171f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Returning 404 to user: Snapshot 297d1dca-6230-4bb7-900e-d859da433a6c could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:00.093383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-ec3a862b-074c-4c42-8cd3-5422524c171f tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c" status: 404 len: 111 microversion: 2.1 time: 0.036604 Jul 26 15:09:00.094334 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 585/1195] 10.222.0.97 () {58 vars in 1251 bytes} [Tue Jul 26 15:09:00 2022] GET /compute/v2.1/os-snapshots/297d1dca-6230-4bb7-900e-d859da433a6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:09:00.097678 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-dfd72447-4d6b-4738-9ec1-2f7c7471a3bf tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e65bf1f0>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.320765 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-dfd72447-4d6b-4738-9ec1-2f7c7471a3bf tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 202 len: 0 microversion: 2.1 time: 0.227259 Jul 26 15:09:00.321468 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 611/1196] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:09:00 2022] DELETE /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:09:00.330913 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f2a1f367-d6f8-4d4d-8a7e-d1ed675f7274 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6f524c0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:00.379094 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f2a1f367-d6f8-4d4d-8a7e-d1ed675f7274 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 200 len: 345 microversion: 2.1 time: 0.052590 Jul 26 15:09:00.379760 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 586/1197] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:09:00 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 15:09:01.394762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a1c218f4-2062-4c5c-983b-e0b1bbab6f99 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e6552310>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.426520 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-a1c218f4-2062-4c5c-983b-e0b1bbab6f99 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] HTTP exception thrown: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a1c218f4-2062-4c5c-983b-e0b1bbab6f99 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Request method failure captured: Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 HTTP/1.1 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AOCxE7sOHRoL3O6mgmm_xmpry8wE_8Qfcrvzb1ZLN6xGgZxMMghieA-2RhuEGXmM0-BmNH6DYRWJxn7pGPT78svEdniQ_nZyNvrE_YQ5CCFLeMUQ2_08gi9X3kp9mj6KUebUJ238Ip2JRy-HVqtHAp1_CaZ0wRvwKUB6iSOAKJaqbI Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:09:01.429086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/e06910a243dd43d7976f10a6b87dba00"}]}] Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: efbd1801fa1f42cc8e279152c2e036d2 Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'ef29b431-15d5-4539-8d84-ac56537c14a7'} Jul 26 15:09:01.430756 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. (HTTP 404) (Request-ID: req-06ed5d6a-2b04-4151-9467-6bd9c4d648df) Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.431821 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:01.433128 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:09:01.434450 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-a1c218f4-2062-4c5c-983b-e0b1bbab6f99 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Returning 404 to user: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-a1c218f4-2062-4c5c-983b-e0b1bbab6f99 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 404 len: 109 microversion: 2.1 time: 0.040515 Jul 26 15:09:01.436330 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 612/1198] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:09:01 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 15:09:01.448534 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61d9865f-ad2c-436a-8744-cdc09ee4de14 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e61e8ee0>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-61d9865f-ad2c-436a-8744-cdc09ee4de14 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] HTTP exception thrown: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61d9865f-ad2c-436a-8744-cdc09ee4de14 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Request method failure captured: Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: DELETE /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 HTTP/1.1 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4AOCxE7sOHRoL3O6mgmm_xmpry8wE_8Qfcrvzb1ZLN6xGgZxMMghieA-2RhuEGXmM0-BmNH6DYRWJxn7pGPT78svEdniQ_nZyNvrE_YQ5CCFLeMUQ2_08gi9X3kp9mj6KUebUJ238Ip2JRy-HVqtHAp1_CaZ0wRvwKUB6iSOAKJaqbI Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:09:01.487037 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/e06910a243dd43d7976f10a6b87dba00"}]}] Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: efbd1801fa1f42cc8e279152c2e036d2 Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': 'ef29b431-15d5-4539-8d84-ac56537c14a7'} Jul 26 15:09:01.490350 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. (HTTP 404) (Request-ID: req-23a8be68-685c-4a06-9b72-1ac2a146e8fd) Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.491500 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 15:09:01.493028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 15:09:01.494633 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-61d9865f-ad2c-436a-8744-cdc09ee4de14 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Returning 404 to user: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-61d9865f-ad2c-436a-8744-cdc09ee4de14 tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 404 len: 109 microversion: 2.1 time: 0.041398 Jul 26 15:09:01.496134 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 587/1199] 10.222.0.97 () {58 vars in 1248 bytes} [Tue Jul 26 15:09:01 2022] DELETE /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:09:01.497333 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e8c32dfd-8413-4916-abca-7019e0da1b3b tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Calling method '.version_select at 0x7f97e65bf700>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.wsgi [None req-e8c32dfd-8413-4916-abca-7019e0da1b3b tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] HTTP exception thrown: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e8c32dfd-8413-4916-abca-7019e0da1b3b tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Request method failure captured: Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: request: GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 HTTP/1.1 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept: application/json Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Accept-Encoding: identity Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Connection: close Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Length: 0 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Content-Type: application/json Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Host: 10.222.0.97 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Openstack-System-Scope: None Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: User-Agent: python-urllib3/1.26.10 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Auth-Token: gAAAAABi4AOCxE7sOHRoL3O6mgmm_xmpry8wE_8Qfcrvzb1ZLN6xGgZxMMghieA-2RhuEGXmM0-BmNH6DYRWJxn7pGPT78svEdniQ_nZyNvrE_YQ5CCFLeMUQ2_08gi9X3kp9mj6KUebUJ238Ip2JRy-HVqtHAp1_CaZ0wRvwKUB6iSOAKJaqbI Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Id: None Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Domain-Name: None Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Identity-Status: Confirmed Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Is-Admin-Project: True Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Id: default Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Domain-Name: Default Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Role: reader,member Jul 26 15:09:01.542951 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Roles: reader,member Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/e06910a243dd43d7976f10a6b87dba00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/e06910a243dd43d7976f10a6b87dba00"}]}] Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Id: e06910a243dd43d7976f10a6b87dba00 Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-842979869 Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Id: default Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Domain-Name: Default Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Id: efbd1801fa1f42cc8e279152c2e036d2 Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: X-User-Name: tempest-VolumesSnapshotsTestJSON-842979869-project Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: method: Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: exception: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: action_args: {'id': 'ef29b431-15d5-4539-8d84-ac56537c14a7'} Jul 26 15:09:01.545480 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. (HTTP 404) (Request-ID: req-046d2a6d-f636-499b-b5de-55ea3c5d20a2) Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.546933 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 15:09:01.549367 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 15:09:01.551606 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR nova.api.openstack.wsgi Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e8c32dfd-8413-4916-abca-7019e0da1b3b tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] Returning 404 to user: Volume ef29b431-15d5-4539-8d84-ac56537c14a7 could not be found. {{(pid=124889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e8c32dfd-8413-4916-abca-7019e0da1b3b tempest-VolumesSnapshotsTestJSON-842979869 tempest-VolumesSnapshotsTestJSON-842979869-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7" status: 404 len: 109 microversion: 2.1 time: 0.042142 Jul 26 15:09:01.553831 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 613/1200] 10.222.0.97 () {58 vars in 1245 bytes} [Tue Jul 26 15:09:01 2022] GET /compute/v2.1/os-volumes/ef29b431-15d5-4539-8d84-ac56537c14a7 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:10:22.493253 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:10:22.493923 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:10:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:10:22.753604 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:10:22.754215 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:10:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:10:33.085714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1447173221", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "networks": [{"uuid": "85456604-f4b2-49b2-b5c4-9628e28dafb8"}]}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:33.138121 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.network.neutron [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] validate_networks() for [('85456604-f4b2-49b2-b5c4-9628e28dafb8', None, None, None, None, None)] {{(pid=124888) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:10:33.540300 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Flavor limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:10:33.540751 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Image limits 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:10:33.541230 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Flavor pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:10:33.541796 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Image pref 0:0:0 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:10:33.542182 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.virt.hardware [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124888) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:10:33.550998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.552049 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.553270 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:33.553717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:33.571167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Getting quotas for project 8eeedf7fb2d847f685b76ec5c52755c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:10:33.575360 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.quota [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Getting quotas for user 8169f0b72007448b805e4447cc835e0f and project 8eeedf7fb2d847f685b76ec5c52755c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124888) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:10:33.586496 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Going to run 1 instances... {{(pid=124888) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:10:33.589317 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124888) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:10:33.739714 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-24272c8f-b414-4121-b435-6bd666188b30 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660508 Jul 26 15:10:33.740356 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 588/1201] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:10:33.749968 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: ERROR oslo.messaging._drivers.impl_rabbit [-] [54c913d6-e47b-43a4-8c1c-e7da6c3cc83f] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 15:10:33.754451 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2e2fc036-916a-47bd-9368-2c60ccb1d592 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:33.756138 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2e2fc036-916a-47bd-9368-2c60ccb1d592 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:33.810089 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2e2fc036-916a-47bd-9368-2c60ccb1d592 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:33.816818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2e2fc036-916a-47bd-9368-2c60ccb1d592 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1219 microversion: 2.1 time: 0.069527 Jul 26 15:10:33.817378 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 614/1202] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:33 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:34.838136 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b5bd8430-5230-46ee-b64b-8e0e873eed0e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:34.840402 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b5bd8430-5230-46ee-b64b-8e0e873eed0e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:34.891487 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b5bd8430-5230-46ee-b64b-8e0e873eed0e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:34.899233 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b5bd8430-5230-46ee-b64b-8e0e873eed0e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1219 microversion: 2.1 time: 0.065284 Jul 26 15:10:34.903532 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 589/1203] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:34 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:35.920766 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:35.921374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:35.928818 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.929308 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.930141 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:35.930543 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:35.947855 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] [54c913d6-e47b-43a4-8c1c-e7da6c3cc83f] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 44690. Jul 26 15:10:36.000904 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:36.009534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-aecdcb25-8ba4-480a-8685-0bfd11347be0 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1271 microversion: 2.1 time: 0.092983 Jul 26 15:10:36.010101 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 615/1204] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:35 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:10:37.030221 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:37.030876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:37.039484 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:37.039997 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:37.040793 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:37.041237 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:37.122177 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:37.130426 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-99ea642d-b75a-4e9b-b816-39504da6f158 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1289 microversion: 2.1 time: 0.104068 Jul 26 15:10:37.131005 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 590/1205] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:37 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1289 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:38.151999 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:38.152615 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:38.160000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:38.160390 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:38.161684 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:38.162126 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:38.296286 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:38.303826 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ab836149-73ab-4408-869c-1029f479d458 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.155808 Jul 26 15:10:38.304762 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 616/1206] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:38 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:38.480968 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-0446fb19-366b-41ee-8596-49666528b00e req-3e631be1-72e2-4916-a9b0-21626c0fe0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f8564f7-c7a4-4207-8793-8eaf68524f76", "tag": "4e82af32-dfbc-48a6-b6af-adea0c662bce"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:38.490998 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-0446fb19-366b-41ee-8596-49666528b00e req-3e631be1-72e2-4916-a9b0-21626c0fe0ff service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:38.491470 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-0446fb19-366b-41ee-8596-49666528b00e req-3e631be1-72e2-4916-a9b0-21626c0fe0ff service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:38.502996 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-0446fb19-366b-41ee-8596-49666528b00e req-3e631be1-72e2-4916-a9b0-21626c0fe0ff service nova] Creating event network-changed:4e82af32-dfbc-48a6-b6af-adea0c662bce for instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 on hv-cinder-85103 Jul 26 15:10:38.507964 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-0446fb19-366b-41ee-8596-49666528b00e req-3e631be1-72e2-4916-a9b0-21626c0fe0ff service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Jul 26 15:10:38.508546 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 591/1207] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:39.244021 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:10:39.244516 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:10:39.325169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:39.325784 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:39.332418 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:39.332866 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:39.333732 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:39.334197 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:39.476639 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:39.484410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-79cf75db-48b2-4b9a-b2f0-eb55db6142c8 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.163277 Jul 26 15:10:39.486089 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 617/1208] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:39 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:40.509137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:40.509813 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:40.516748 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:40.517451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:40.518223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:40.518686 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:40.651781 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:40.659893 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-962e83fc-2084-4ab8-a519-5e67de5c62b4 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.156408 Jul 26 15:10:40.661516 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 592/1209] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:40 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:41.681090 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:41.681727 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:41.688369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:41.688812 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:41.689651 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:41.690081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:41.827964 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:41.836392 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-84edea5f-5edb-4688-a7b7-22a1e1cc3ce9 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.159219 Jul 26 15:10:41.836963 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 618/1210] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:41 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:42.857717 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:42.858368 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:42.865039 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:42.865482 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:42.866259 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:42.866689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:42.996524 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:43.004320 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-970805e3-af69-4fed-86f1-ce69dab70fe3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.150434 Jul 26 15:10:43.004898 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 593/1211] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:42 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:44.025088 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:44.025736 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:44.028096 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:44.032922 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.033374 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.034144 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.034577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.167448 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:44.175084 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-67275930-e61e-484d-8cc9-86721e114ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.154143 Jul 26 15:10:44.175695 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 619/1212] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:44 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:44.581025 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:44.729144 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-e301512b-9e8c-4034-96c6-24969027ef94 req-d8f53025-1ec6-4a5e-8da3-76466c4699aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8564f7-c7a4-4207-8793-8eaf68524f76", "name": "network-vif-plugged", "status": "completed", "tag": "4e82af32-dfbc-48a6-b6af-adea0c662bce"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:10:44.739656 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e301512b-9e8c-4034-96c6-24969027ef94 req-d8f53025-1ec6-4a5e-8da3-76466c4699aa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:44.740711 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-e301512b-9e8c-4034-96c6-24969027ef94 req-d8f53025-1ec6-4a5e-8da3-76466c4699aa service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:44.752114 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-e301512b-9e8c-4034-96c6-24969027ef94 req-d8f53025-1ec6-4a5e-8da3-76466c4699aa service nova] Creating event network-vif-plugged:4e82af32-dfbc-48a6-b6af-adea0c662bce for instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 on hv-cinder-85103 Jul 26 15:10:44.757816 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-e301512b-9e8c-4034-96c6-24969027ef94 req-d8f53025-1ec6-4a5e-8da3-76466c4699aa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182328 Jul 26 15:10:44.759906 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 594/1213] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:10:45.201070 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:45.201718 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:45.209201 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:45.209656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:45.210521 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:45.210961 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:45.342994 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:45.351221 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e92591db-c2db-4098-8042-4c6ddd73ff00 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.154154 Jul 26 15:10:45.351816 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 620/1214] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:45 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:46.372786 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:46.373454 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:46.375377 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=8 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:10:46.381437 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:46.381926 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:46.382702 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:46.383137 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:46.515268 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:46.523858 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-7ba0e592-cc05-44ff-9f2e-07625b7faf51 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1319 microversion: 2.1 time: 0.155347 Jul 26 15:10:46.524486 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 595/1215] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:46 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:10:47.545216 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:10:47.545871 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:10:47.552323 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:47.552769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:47.553534 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:10:47.553970 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:10:47.681239 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:10:47.688850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-8ac704af-c566-409c-8047-a60f26bb3eda tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1508 microversion: 2.1 time: 0.147585 Jul 26 15:10:47.689411 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 621/1216] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:10:47 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:11.784763 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3082cc9-cea9-479d-bf73-e94b7e1edc57", "device": "/dev/sdb"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:11.788440 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:11.790492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.791260 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=30 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:11.796074 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.802581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:11.802581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:11.802581 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:12.693769 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-c0fa20db-f010-42ef-af15-403b75117a31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "POST /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912981 Jul 26 15:11:12.694382 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 596/1217] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:11:11 2022] POST /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:42.010366 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:42.010907 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:42.013102 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=18 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.013758 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=42 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:42.018580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.037540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.037540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:42.037540 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:42.102577 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lazy-loading 'services' on Instance uuid 0f8564f7-c7a4-4207-8793-8eaf68524f76 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:42.408153 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-58692cd9-f812-4343-aeca-19ee50d9d8b1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "DELETE /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76/os-volume_attachments/f3082cc9-cea9-479d-bf73-e94b7e1edc57" status: 202 len: 0 microversion: 2.1 time: 0.401503 Jul 26 15:11:42.408920 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 622/1218] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:11:42 2022] DELETE /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76/os-volume_attachments/f3082cc9-cea9-479d-bf73-e94b7e1edc57 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:11:44.600614 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.601479 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:11:44.605775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:44.606362 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:44.612917 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.615186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.615186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:44.615186 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:44.640591 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:11:45.151018 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-f287c809-09cc-4497-902b-1bab9d774f31 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "DELETE /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 204 len: 0 microversion: 2.1 time: 0.551582 Jul 26 15:11:45.151637 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 597/1219] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:11:44 2022] DELETE /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:11:45.160931 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:45.161671 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:45.168193 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.168646 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.169422 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:45.169864 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:45.305783 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:45.313286 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-74399816-c679-4031-9511-aa1ed5005e4c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1514 microversion: 2.1 time: 0.157227 Jul 26 15:11:45.313850 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 623/1220] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:45 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:46.336692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:46.337305 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:46.344202 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.344644 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.345414 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:46.345847 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:46.480627 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:46.488262 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-5d0da663-8b39-4c97-86a0-348f80cce313 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1514 microversion: 2.1 time: 0.157109 Jul 26 15:11:46.493054 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 598/1221] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:46 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.510385 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:47.511061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:47.517700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.518156 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.520342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.520342 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.650546 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:47.659236 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-09f084a6-c761-4b04-87fa-14d7586a9695 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1514 microversion: 2.1 time: 0.152847 Jul 26 15:11:47.660061 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 624/1222] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:47 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:11:47.753141 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-bb551206-9a43-4de7-b065-eea7ede10d2f req-de09a5a6-1d04-47ad-af02-86dcf4e9907d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f8564f7-c7a4-4207-8793-8eaf68524f76", "name": "network-vif-deleted", "tag": "4e82af32-dfbc-48a6-b6af-adea0c662bce"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:11:47.764147 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-bb551206-9a43-4de7-b065-eea7ede10d2f req-de09a5a6-1d04-47ad-af02-86dcf4e9907d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:47.765277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-bb551206-9a43-4de7-b065-eea7ede10d2f req-de09a5a6-1d04-47ad-af02-86dcf4e9907d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:47.776802 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-bb551206-9a43-4de7-b065-eea7ede10d2f req-de09a5a6-1d04-47ad-af02-86dcf4e9907d service nova] Creating event network-vif-deleted:4e82af32-dfbc-48a6-b6af-adea0c662bce for instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 on hv-cinder-85103 Jul 26 15:11:47.781692 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-bb551206-9a43-4de7-b065-eea7ede10d2f req-de09a5a6-1d04-47ad-af02-86dcf4e9907d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Jul 26 15:11:47.782277 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 599/1223] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:11:48.680679 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:48.681327 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:48.687925 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.688380 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.689150 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.689591 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.720410 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:48.720856 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:48.721301 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lazy-loading 'fault' on Instance uuid 0f8564f7-c7a4-4207-8793-8eaf68524f76 {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:11:48.767798 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:11:48.771371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-2610c129-da52-4ebd-ac86-a3fcb20fbcfc tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 200 len: 1309 microversion: 2.1 time: 0.094565 Jul 26 15:11:48.771981 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 625/1224] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:48 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:11:49.794691 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:11:49.795390 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 0f8564f7-c7a4-4207-8793-8eaf68524f76] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:11:49.802223 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.802673 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.803463 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:11:49.803900 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:11:49.817688 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] HTTP exception thrown: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Request method failure captured: Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 HTTP/1.1 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4APmytfRanpB6dLMNvDWKKePi3OsUtYd0R1AyABvNGckUlpZWOgfxzhgzeVkIL_F6BOfG-trPO7Nq5OKPVPnwmTitlsZpqddWZg2Mi9SNywQS_ffjORh6fKZG60TlM1w9Y3Dku_vOAMWnJmW3-IOu0Lc0ah1pgJBPWuYBlq9lRKPXJU Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 8eeedf7fb2d847f685b76ec5c52755c4 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:11:49.819295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/8eeedf7fb2d847f685b76ec5c52755c4"}]}] Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 8eeedf7fb2d847f685b76ec5c52755c4 Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesSnapshotTestJSON-196107377-project Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 8169f0b72007448b805e4447cc835e0f Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesSnapshotTestJSON-196107377-project Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. Jul 26 15:11:49.820962 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '0f8564f7-c7a4-4207-8793-8eaf68524f76'} Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:11:49.821936 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. Jul 26 15:11:49.823330 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:11:49.824730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Returning 404 to user: Instance 0f8564f7-c7a4-4207-8793-8eaf68524f76 could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:11:49.824730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9e1de646-6b9a-4a37-90ac-97a836829b04 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76" status: 404 len: 111 microversion: 2.1 time: 0.030871 Jul 26 15:11:49.824730 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 600/1225] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:11:49 2022] GET /compute/v2.1/servers/0f8564f7-c7a4-4207-8793-8eaf68524f76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:11:53.465039 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:11:53.465905 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:11:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:12:00.384938 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1528297348", "imageRef": "358d314c-b745-45f8-910c-d7a4ced30826", "flavorRef": "452", "networks": [{"uuid": "85456604-f4b2-49b2-b5c4-9628e28dafb8"}]}} {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:00.393769 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=10 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:00.394460 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:00.444324 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.network.neutron [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] validate_networks() for [('85456604-f4b2-49b2-b5c4-9628e28dafb8', None, None, None, None, None)] {{(pid=124889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 15:12:00.865608 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Flavor limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 15:12:00.866039 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Image limits 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 15:12:00.866504 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Flavor pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 15:12:00.866910 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Image pref 0:0:0 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 15:12:00.867318 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.virt.hardware [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 15:12:00.876561 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.877004 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.878248 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:00.878846 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:00.899583 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Getting quotas for project 8eeedf7fb2d847f685b76ec5c52755c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 15:12:00.903732 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.quota [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Getting quotas for user 8169f0b72007448b805e4447cc835e0f and project 8eeedf7fb2d847f685b76ec5c52755c4. Resources: {'instances', 'ram', 'cores'} {{(pid=124889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 15:12:00.915801 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Going to run 1 instances... {{(pid=124889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 15:12:00.918199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='358d314c-b745-45f8-910c-d7a4ced30826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 15:12:01.180516 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9967d702-22f3-4dd4-bbfd-7c7979faf84b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799386 Jul 26 15:12:01.181086 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 626/1226] 10.222.0.97 () {60 vars in 1147 bytes} [Tue Jul 26 15:12:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 26 15:12:01.193825 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-63b7f1f1-65e6-4fbc-bae2-109e910ad885 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:01.194419 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-63b7f1f1-65e6-4fbc-bae2-109e910ad885 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:01.196846 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.197543 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:01.320299 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-63b7f1f1-65e6-4fbc-bae2-109e910ad885 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:01.328357 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-63b7f1f1-65e6-4fbc-bae2-109e910ad885 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1219 microversion: 2.1 time: 0.138594 Jul 26 15:12:01.328970 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 601/1227] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:01 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:02.351705 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:02.354853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:02.361419 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.364640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.364640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:02.364640 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:02.502227 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:02.511916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-f082e6bf-78a8-4be4-979a-01a2a5d2e76c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1223 microversion: 2.1 time: 0.165381 Jul 26 15:12:02.512527 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 627/1228] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:02 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:03.534349 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:03.534954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:03.543495 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.543959 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.544733 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:03.545175 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:03.622988 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:03.630854 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-44557db7-61df-433f-b143-38b488f4dde1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1279 microversion: 2.1 time: 0.100961 Jul 26 15:12:03.631451 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 602/1229] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:03 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1279 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:04.651945 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:04.652580 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:04.661935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:04.661935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:04.661935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:04.661935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:04.816916 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:04.830979 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-db548e46-289a-4986-a41f-6babcaf0ff46 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.182625 Jul 26 15:12:04.832564 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 628/1230] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:04 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:05.718631 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-f1ac80ba-f58b-4ac8-a5c6-728fb507dbaa req-4252e546-8b8c-446f-abed-7dc998b30b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "375b0c21-138e-41d0-a66a-5b74016ad3cf", "tag": "149eb14b-178c-45ed-8a9e-71bd6765cb60"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:05.730498 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f1ac80ba-f58b-4ac8-a5c6-728fb507dbaa req-4252e546-8b8c-446f-abed-7dc998b30b48 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:05.730967 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-f1ac80ba-f58b-4ac8-a5c6-728fb507dbaa req-4252e546-8b8c-446f-abed-7dc998b30b48 service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:05.747578 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-f1ac80ba-f58b-4ac8-a5c6-728fb507dbaa req-4252e546-8b8c-446f-abed-7dc998b30b48 service nova] Creating event network-changed:149eb14b-178c-45ed-8a9e-71bd6765cb60 for instance 375b0c21-138e-41d0-a66a-5b74016ad3cf on hv-cinder-85103 Jul 26 15:12:05.752783 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-f1ac80ba-f58b-4ac8-a5c6-728fb507dbaa req-4252e546-8b8c-446f-abed-7dc998b30b48 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039551 Jul 26 15:12:05.753558 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 603/1231] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:05.857300 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:05.862094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:05.864838 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:05.865299 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:05.866120 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:05.866567 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:06.022140 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:06.030356 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-e94770c3-389f-4252-9be6-607d1a9eb83d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.176989 Jul 26 15:12:06.030935 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 629/1232] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:05 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:07.052004 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:07.052712 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:07.060241 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:07.061359 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:07.062167 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:07.062611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:07.202184 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:07.210312 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-b348b5b8-efda-45cb-84b4-c052ec2e28e3 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.163186 Jul 26 15:12:07.210876 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 604/1233] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:07 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:08.231081 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:08.231700 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:08.239139 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:08.239638 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:08.240428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:08.240870 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:08.379123 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:08.386968 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-cb50abdf-e11b-40d8-a7e0-c93e4edc4650 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.159763 Jul 26 15:12:08.387578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 630/1234] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:08 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:09.409007 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:09.409775 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:09.417251 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:09.417704 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:09.418492 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:09.418924 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:09.561980 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:09.570078 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-cdfe80fb-c652-4a7c-ae32-67cfed5b515c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.165183 Jul 26 15:12:09.570655 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 605/1235] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:09 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:10.592091 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:10.592706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:10.599978 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.600433 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.601217 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.601654 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.770136 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:10.778371 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-9625404d-bf77-401c-93e6-e70a56800eee tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.190188 Jul 26 15:12:10.778953 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 631/1236] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:10 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:10.948383 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-bdabde2f-13d7-4af8-a422-7310c54a2c34 req-9094a8b6-9630-4aa9-8649-3134f3db3d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375b0c21-138e-41d0-a66a-5b74016ad3cf", "name": "network-vif-plugged", "status": "completed", "tag": "149eb14b-178c-45ed-8a9e-71bd6765cb60"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:10.959271 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-bdabde2f-13d7-4af8-a422-7310c54a2c34 req-9094a8b6-9630-4aa9-8649-3134f3db3d6f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:10.960296 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-bdabde2f-13d7-4af8-a422-7310c54a2c34 req-9094a8b6-9630-4aa9-8649-3134f3db3d6f service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:10.971034 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-bdabde2f-13d7-4af8-a422-7310c54a2c34 req-9094a8b6-9630-4aa9-8649-3134f3db3d6f service nova] Creating event network-vif-plugged:149eb14b-178c-45ed-8a9e-71bd6765cb60 for instance 375b0c21-138e-41d0-a66a-5b74016ad3cf on hv-cinder-85103 Jul 26 15:12:10.976864 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-bdabde2f-13d7-4af8-a422-7310c54a2c34 req-9094a8b6-9630-4aa9-8649-3134f3db3d6f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033827 Jul 26 15:12:10.977675 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 606/1237] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:11.799637 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:11.801181 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:11.802409 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=2 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.803076 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell0:SELECT=6 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:11.808901 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:11.809357 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:11.810143 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:11.810576 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:11.963439 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:11.973578 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-71160a54-5b4e-42fd-b1fb-1677d19a3da1 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.177769 Jul 26 15:12:11.974178 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 632/1238] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:11 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:12.992514 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell0:SELECT=2 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:12.997207 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:12.997909 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:13.004165 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.004611 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.007592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:13.007592 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:13.149857 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:13.157940 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-a0d13d9c-1ce0-4f5f-a08d-a24059af467e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1319 microversion: 2.1 time: 0.166525 Jul 26 15:12:13.158548 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 607/1239] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:12 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:14.179383 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:14.180290 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:14.187057 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.187656 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.188630 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.193001 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.333199 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:14.341228 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-d41d8145-f45d-4cc7-bd31-cd4b4ad10d88 tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1508 microversion: 2.1 time: 0.166252 Jul 26 15:12:14.341819 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 633/1240] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:14 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 15:12:14.362171 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18208f8b-f98b-4f9c-8a8d-6129da7a1f69", "device": "/dev/sdb"}} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:14.364712 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:14.372609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.372609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:14.372609 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:14.372977 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:15.297659 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-29becd72-a525-4b8b-84b7-61e44e55d72b tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "POST /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939384 Jul 26 15:12:15.298379 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 608/1241] 10.222.0.97 () {60 vars in 1323 bytes} [Tue Jul 26 15:12:14 2022] POST /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:38.710094 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:38.710672 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:38.712853 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:38.713506 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG dbcounter [-] [124889] Writing DB stats nova_cell1:SELECT=44 {{(pid=124889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:38.718582 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.719039 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.719886 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:38.720381 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:38.804776 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lazy-loading 'services' on Instance uuid 375b0c21-138e-41d0-a66a-5b74016ad3cf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:39.058499 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-367d1d88-9f8c-4967-abc3-7801b4c24ede tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "DELETE /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf/os-volume_attachments/18208f8b-f98b-4f9c-8a8d-6129da7a1f69" status: 202 len: 0 microversion: 2.1 time: 0.352167 Jul 26 15:12:39.059159 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 634/1242] 10.222.0.97 () {58 vars in 1416 bytes} [Tue Jul 26 15:12:38 2022] DELETE /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf/os-volume_attachments/18208f8b-f98b-4f9c-8a8d-6129da7a1f69 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 15:12:41.242689 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_api:SELECT=18 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:41.243490 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG dbcounter [-] [124888] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124888) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 15:12:41.247621 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:41.251954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:41.255890 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.256348 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.257139 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.257584 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.285705 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Going to try to terminate instance {{(pid=124888) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 15:12:41.615028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-8fff3ec9-187a-45fa-88d4-8319cfcc718a tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "DELETE /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 204 len: 0 microversion: 2.1 time: 0.373240 Jul 26 15:12:41.615303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 609/1243] 10.222.0.97 () {58 vars in 1239 bytes} [Tue Jul 26 15:12:41 2022] DELETE /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 15:12:41.625000 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:41.625738 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:41.636600 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.637147 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.637952 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:41.638394 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:41.814225 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:41.822428 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-bf951c0d-ba62-4858-bbbd-6b53bed39ddf tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1514 microversion: 2.1 time: 0.202178 Jul 26 15:12:41.823015 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 635/1244] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:41 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1514 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:42.844785 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:42.845488 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:42.852636 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:42.853081 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:42.853865 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:42.854303 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:43.005547 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.policy [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124888) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:43.016588 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-9d0510b8-a806-4fa8-8182-9497a893db6e tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1514 microversion: 2.1 time: 0.175943 Jul 26 15:12:43.017188 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 610/1245] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:42 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:44.038624 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:44.040135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:44.051883 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.053169 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.054918 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.055983 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.233779 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:44.242653 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-ed68dd30-0e00-4172-ace6-b6b0aaf6553d tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1514 microversion: 2.1 time: 0.208227 Jul 26 15:12:44.243250 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 636/1246] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:44 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:44.353495 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [req-d800b7b5-4fa8-48c6-9923-e1469f999d1e req-dc4ecd7e-c5a5-4337-a021-f0ecdbfadc9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "375b0c21-138e-41d0-a66a-5b74016ad3cf", "name": "network-vif-deleted", "tag": "149eb14b-178c-45ed-8a9e-71bd6765cb60"}]} {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 15:12:44.364651 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-d800b7b5-4fa8-48c6-9923-e1469f999d1e req-dc4ecd7e-c5a5-4337-a021-f0ecdbfadc9d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:44.365083 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [req-d800b7b5-4fa8-48c6-9923-e1469f999d1e req-dc4ecd7e-c5a5-4337-a021-f0ecdbfadc9d service nova] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:44.376791 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.compute.server_external_events [req-d800b7b5-4fa8-48c6-9923-e1469f999d1e req-dc4ecd7e-c5a5-4337-a021-f0ecdbfadc9d service nova] Creating event network-vif-deleted:149eb14b-178c-45ed-8a9e-71bd6765cb60 for instance 375b0c21-138e-41d0-a66a-5b74016ad3cf on hv-cinder-85103 Jul 26 15:12:44.382597 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [req-d800b7b5-4fa8-48c6-9923-e1469f999d1e req-dc4ecd7e-c5a5-4337-a021-f0ecdbfadc9d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Jul 26 15:12:44.383203 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 611/1247] 10.222.0.97 () {64 vars in 1317 bytes} [Tue Jul 26 15:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 15:12:45.272609 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.api.openstack.wsgi [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:45.273247 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.compute.api [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124889) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:45.280742 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.281272 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.282066 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.282508 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.323166 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:45.323837 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG oslo_concurrency.lockutils [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:45.324369 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.objects.instance [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lazy-loading 'fault' on Instance uuid 375b0c21-138e-41d0-a66a-5b74016ad3cf {{(pid=124889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 15:12:45.373135 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: DEBUG nova.policy [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8169f0b72007448b805e4447cc835e0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8eeedf7fb2d847f685b76ec5c52755c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124889) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 15:12:45.381447 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO nova.api.openstack.requestlog [None req-fc482ad8-730d-4423-a1d4-2beca7f2a36c tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 200 len: 1309 microversion: 2.1 time: 0.112787 Jul 26 15:12:45.382044 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: [pid: 124889|app: 0|req: 637/1248] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:45 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 15:12:46.404256 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Calling method '>' {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 15:12:46.405336 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.compute.api [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] [instance: 375b0c21-138e-41d0-a66a-5b74016ad3cf] Fetching instance by UUID {{(pid=124888) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 15:12:46.412172 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:46.412629 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:46.413421 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 15:12:46.413885 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG oslo_concurrency.lockutils [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Lock "b94e0a29-23eb-489d-a693-b18b7475483a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124888) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 15:12:46.428838 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.wsgi [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] HTTP exception thrown: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Request method failure captured: Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: request: GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf HTTP/1.1 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept: application/json Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Accept-Encoding: identity Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Connection: close Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Length: 0 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Content-Type: application/json Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Host: 10.222.0.97 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Openstack-System-Scope: None Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: User-Agent: python-urllib3/1.26.10 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Auth-Token: gAAAAABi4APmytfRanpB6dLMNvDWKKePi3OsUtYd0R1AyABvNGckUlpZWOgfxzhgzeVkIL_F6BOfG-trPO7Nq5OKPVPnwmTitlsZpqddWZg2Mi9SNywQS_ffjORh6fKZG60TlM1w9Y3Dku_vOAMWnJmW3-IOu0Lc0ah1pgJBPWuYBlq9lRKPXJU Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Id: None Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Domain-Name: None Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Identity-Status: Confirmed Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Is-Admin-Project: True Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Id: default Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Domain-Name: Default Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Id: 8eeedf7fb2d847f685b76ec5c52755c4 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Project-Name: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Role: reader,member Jul 26 15:12:46.430519 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Roles: reader,member Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.97:8080", "publicURL": "http://10.222.0.97:8080/v1/AUTH_8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8eeedf7fb2d847f685b76ec5c52755c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/8eeedf7fb2d847f685b76ec5c52755c4"}]}] Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Id: 8eeedf7fb2d847f685b76ec5c52755c4 Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-196107377 Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User: tempest-VolumesSnapshotTestJSON-196107377-project Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Id: default Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Domain-Name: Default Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Id: 8169f0b72007448b805e4447cc835e0f Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: X-User-Name: tempest-VolumesSnapshotTestJSON-196107377-project Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: method: > Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: exception: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. Jul 26 15:12:46.432220 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: action_args: {'id': '375b0c21-138e-41d0-a66a-5b74016ad3cf'} Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: {{(pid=124888) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 15:12:46.433088 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. Jul 26 15:12:46.434903 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: ERROR nova.api.openstack.wsgi Jul 26 15:12:46.437295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: DEBUG nova.api.openstack.wsgi [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] Returning 404 to user: Instance 375b0c21-138e-41d0-a66a-5b74016ad3cf could not be found. {{(pid=124888) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 15:12:46.437295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO nova.api.openstack.requestlog [None req-44ce6eb3-9522-4b09-8155-9c61f42772db tempest-VolumesSnapshotTestJSON-196107377 tempest-VolumesSnapshotTestJSON-196107377-project] 10.222.0.97 "GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf" status: 404 len: 111 microversion: 2.1 time: 0.033509 Jul 26 15:12:46.437295 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: [pid: 124888|app: 0|req: 612/1249] 10.222.0.97 () {58 vars in 1236 bytes} [Tue Jul 26 15:12:46 2022] GET /compute/v2.1/servers/375b0c21-138e-41d0-a66a-5b74016ad3cf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 15:13:42.503028 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:13:42.503827 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:13:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:13:45.982161 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:13:45.983057 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:15:13.475218 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:15:13.475944 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:15:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:15:36.622954 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:15:36.623623 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:15:39.254087 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:15:39.254706 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:15:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:17:02.512085 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:17:02.512709 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:17:02.766572 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:17:02.767175 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:17:05.991499 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:17:05.992217 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:18:33.483879 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:18:33.484485 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:18:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:18:56.631620 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:18:56.632281 dv-cinder-851030-1-iscsi devstack@n-api.service[124888]: Tue Jul 26 15:18:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 15:18:59.262455 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 15:18:59.263055 dv-cinder-851030-1-iscsi devstack@n-api.service[124889]: Tue Jul 26 15:18:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!